You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Doug Cutting (JIRA)" <ji...@apache.org> on 2008/01/10 20:31:34 UTC
[jira] Created: (HADOOP-2574) bugs in mapred tutorial
bugs in mapred tutorial
-----------------------
Key: HADOOP-2574
URL: https://issues.apache.org/jira/browse/HADOOP-2574
Project: Hadoop
Issue Type: Bug
Components: documentation
Reporter: Doug Cutting
Fix For: 0.15.3, 0.16.0
Sam Pullara sends me:
{noformat}
Phu was going through the WordCount example... lines 52 and 53 should have args[0] and args[1]:
http://lucene.apache.org/hadoop/docs/current/mapred_tutorial.html
The javac and jar command are also wrong, they don't include the directories for the packages, should be:
$ javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d classes WordCount.java
$ jar -cvf /usr/joe/wordcount.jar WordCount.class -C classes .
{noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2574) bugs in mapred tutorial
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12558284#action_12558284 ]
Hadoop QA commented on HADOOP-2574:
-----------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12373013/HADOOP-2574_0_20080110.patch
against trunk revision r611385.
@author +1. The patch does not contain any @author tags.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new compiler warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1558/testReport/
Findbugs warnings: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1558/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1558/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1558/console
This message is automatically generated.
> bugs in mapred tutorial
> -----------------------
>
> Key: HADOOP-2574
> URL: https://issues.apache.org/jira/browse/HADOOP-2574
> Project: Hadoop
> Issue Type: Bug
> Components: documentation
> Reporter: Doug Cutting
> Assignee: Arun C Murthy
> Fix For: 0.15.3, 0.16.0
>
> Attachments: HADOOP-2574_0_20080110.patch, mapred_tutorial.html
>
>
> Sam Pullara sends me:
> {noformat}
> Phu was going through the WordCount example... lines 52 and 53 should have args[0] and args[1]:
> http://lucene.apache.org/hadoop/docs/current/mapred_tutorial.html
> The javac and jar command are also wrong, they don't include the directories for the packages, should be:
> $ javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d classes WordCount.java
> $ jar -cvf /usr/joe/wordcount.jar WordCount.class -C classes .
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2574) bugs in mapred tutorial
Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557846#action_12557846 ]
Nigel Daley commented on HADOOP-2574:
-------------------------------------
Is this a blocker for 0.15.3? I'd say no. Devaraj or Arun, can you look at these issues?
> bugs in mapred tutorial
> -----------------------
>
> Key: HADOOP-2574
> URL: https://issues.apache.org/jira/browse/HADOOP-2574
> Project: Hadoop
> Issue Type: Bug
> Components: documentation
> Reporter: Doug Cutting
> Fix For: 0.15.3, 0.16.0
>
>
> Sam Pullara sends me:
> {noformat}
> Phu was going through the WordCount example... lines 52 and 53 should have args[0] and args[1]:
> http://lucene.apache.org/hadoop/docs/current/mapred_tutorial.html
> The javac and jar command are also wrong, they don't include the directories for the packages, should be:
> $ javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d classes WordCount.java
> $ jar -cvf /usr/joe/wordcount.jar WordCount.class -C classes .
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2574) bugs in mapred tutorial
Posted by "Phu Hoang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12557830#action_12557830 ]
Phu Hoang commented on HADOOP-2574:
-----------------------------------
On WordCount v1.0 above, there is also another bug:
line 3 should be import java.io.*; instead of import java.io.Exception;
On WordCount v2.0, where local cache files are used, there are also bugs:
1. line 108 and 109 should be:
conf.setInputPath(new Path(other_args.get(0)));
conf.setOutputPath(new Path(other_args.get(1)));
2. If I run the program without using the -skip argument, as in:
~/Hadoop/bin/hadoop jar ~phu/Hadoop/Examples/WordCount2/wordcount.jar org.myorg.WordCount -Dwordcount.case.sensitive=false WordCount2/input WordCount2/output, I get the following error message:
java.lang.NullPointerException
at org.apache.hadoop.util.StringUtils.stringToPath(StringUtils.java:197)
at org.apache.hadoop.filecache.DistributedCache.getLocalCacheFiles(DistributedCache.java:470)
at org.myorg.WordCount$MapClass.configure(WordCount.java:33)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:58)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:82)
at org.apache.hadoop.mapred.MapRunner.configure(MapRunner.java:36)
at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:58)
at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:82)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:188)
at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1760)
Exception in thread "main" java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:831)
at org.myorg.WordCount.run(WordCount.java:110)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.myorg.WordCount.main(WordCount.java:115)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at org.apache.hadoop.util.RunJar.main(RunJar.java:155)
Looking at DistributedCache.java, line 470, we see:
return StringUtils.stringToPath(conf.getStrings("mapred.cache.localFiles"));
conf.getStrings is returning NULL. So somehow we have to initialize this so that it does not throw an exception when the -skip argument is not used.
When I do put in the -skip patterns.txt file, the program works.
Lastly,
WordCount v1.0 works even if I do not use DFS, and just access local input and output files. WordCount v2.0 does not work if I do not use DFS. The quickstart tutorial does not make it clear which examples work under which scenarios (Stand alone, Pseudo-Distributed, or Fully-Distributed). One could be mistaken to thinking that all examples work under all scenarios.
Phu
> bugs in mapred tutorial
> -----------------------
>
> Key: HADOOP-2574
> URL: https://issues.apache.org/jira/browse/HADOOP-2574
> Project: Hadoop
> Issue Type: Bug
> Components: documentation
> Reporter: Doug Cutting
> Fix For: 0.15.3, 0.16.0
>
>
> Sam Pullara sends me:
> {noformat}
> Phu was going through the WordCount example... lines 52 and 53 should have args[0] and args[1]:
> http://lucene.apache.org/hadoop/docs/current/mapred_tutorial.html
> The javac and jar command are also wrong, they don't include the directories for the packages, should be:
> $ javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d classes WordCount.java
> $ jar -cvf /usr/joe/wordcount.jar WordCount.class -C classes .
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2574) bugs in mapred tutorial
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12559055#action_12559055 ]
Hudson commented on HADOOP-2574:
--------------------------------
Integrated in Hadoop-Nightly #366 (See [http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/366/])
> bugs in mapred tutorial
> -----------------------
>
> Key: HADOOP-2574
> URL: https://issues.apache.org/jira/browse/HADOOP-2574
> Project: Hadoop
> Issue Type: Bug
> Components: documentation
> Reporter: Doug Cutting
> Assignee: Arun C Murthy
> Fix For: 0.15.3
>
> Attachments: HADOOP-2574_0_20080110.patch, HADOOP-2574_1_20080114.patch, mapred_tutorial.html, mapred_tutorial.html
>
>
> Sam Pullara sends me:
> {noformat}
> Phu was going through the WordCount example... lines 52 and 53 should have args[0] and args[1]:
> http://lucene.apache.org/hadoop/docs/current/mapred_tutorial.html
> The javac and jar command are also wrong, they don't include the directories for the packages, should be:
> $ javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d classes WordCount.java
> $ jar -cvf /usr/joe/wordcount.jar WordCount.class -C classes .
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2574) bugs in mapred tutorial
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated HADOOP-2574:
----------------------------------
Status: Patch Available (was: Open)
> bugs in mapred tutorial
> -----------------------
>
> Key: HADOOP-2574
> URL: https://issues.apache.org/jira/browse/HADOOP-2574
> Project: Hadoop
> Issue Type: Bug
> Components: documentation
> Reporter: Doug Cutting
> Assignee: Arun C Murthy
> Fix For: 0.15.3, 0.16.0
>
> Attachments: HADOOP-2574_0_20080110.patch, mapred_tutorial.html
>
>
> Sam Pullara sends me:
> {noformat}
> Phu was going through the WordCount example... lines 52 and 53 should have args[0] and args[1]:
> http://lucene.apache.org/hadoop/docs/current/mapred_tutorial.html
> The javac and jar command are also wrong, they don't include the directories for the packages, should be:
> $ javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d classes WordCount.java
> $ jar -cvf /usr/joe/wordcount.jar WordCount.class -C classes .
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2574) bugs in mapred tutorial
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated HADOOP-2574:
----------------------------------
Attachment: mapred_tutorial.html
Here is how the tutorial looks with this patch...
> bugs in mapred tutorial
> -----------------------
>
> Key: HADOOP-2574
> URL: https://issues.apache.org/jira/browse/HADOOP-2574
> Project: Hadoop
> Issue Type: Bug
> Components: documentation
> Reporter: Doug Cutting
> Assignee: Arun C Murthy
> Fix For: 0.15.3, 0.16.0
>
> Attachments: HADOOP-2574_0_20080110.patch, mapred_tutorial.html
>
>
> Sam Pullara sends me:
> {noformat}
> Phu was going through the WordCount example... lines 52 and 53 should have args[0] and args[1]:
> http://lucene.apache.org/hadoop/docs/current/mapred_tutorial.html
> The javac and jar command are also wrong, they don't include the directories for the packages, should be:
> $ javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d classes WordCount.java
> $ jar -cvf /usr/joe/wordcount.jar WordCount.class -C classes .
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2574) bugs in mapred tutorial
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated HADOOP-2574:
----------------------------------
Fix Version/s: (was: 0.16.0)
Status: Patch Available (was: Open)
> bugs in mapred tutorial
> -----------------------
>
> Key: HADOOP-2574
> URL: https://issues.apache.org/jira/browse/HADOOP-2574
> Project: Hadoop
> Issue Type: Bug
> Components: documentation
> Reporter: Doug Cutting
> Assignee: Arun C Murthy
> Fix For: 0.15.3
>
> Attachments: HADOOP-2574_0_20080110.patch, HADOOP-2574_1_20080114.patch, mapred_tutorial.html, mapred_tutorial.html
>
>
> Sam Pullara sends me:
> {noformat}
> Phu was going through the WordCount example... lines 52 and 53 should have args[0] and args[1]:
> http://lucene.apache.org/hadoop/docs/current/mapred_tutorial.html
> The javac and jar command are also wrong, they don't include the directories for the packages, should be:
> $ javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d classes WordCount.java
> $ jar -cvf /usr/joe/wordcount.jar WordCount.class -C classes .
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2574) bugs in mapred tutorial
Posted by "Phu Hoang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12558927#action_12558927 ]
Phu Hoang commented on HADOOP-2574:
-----------------------------------
That is perfect. Sorry I didn't catch that.
Phu
On Jan 14, 2008, at 8:45 PM, "Arun C Murthy \(JIRA\)"
> bugs in mapred tutorial
> -----------------------
>
> Key: HADOOP-2574
> URL: https://issues.apache.org/jira/browse/HADOOP-2574
> Project: Hadoop
> Issue Type: Bug
> Components: documentation
> Reporter: Doug Cutting
> Assignee: Arun C Murthy
> Fix For: 0.15.3
>
> Attachments: HADOOP-2574_0_20080110.patch, HADOOP-2574_1_20080114.patch, mapred_tutorial.html, mapred_tutorial.html
>
>
> Sam Pullara sends me:
> {noformat}
> Phu was going through the WordCount example... lines 52 and 53 should have args[0] and args[1]:
> http://lucene.apache.org/hadoop/docs/current/mapred_tutorial.html
> The javac and jar command are also wrong, they don't include the directories for the packages, should be:
> $ javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d classes WordCount.java
> $ jar -cvf /usr/joe/wordcount.jar WordCount.class -C classes .
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-2574) bugs in mapred tutorial
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy reassigned HADOOP-2574:
-------------------------------------
Assignee: Arun C Murthy
> bugs in mapred tutorial
> -----------------------
>
> Key: HADOOP-2574
> URL: https://issues.apache.org/jira/browse/HADOOP-2574
> Project: Hadoop
> Issue Type: Bug
> Components: documentation
> Reporter: Doug Cutting
> Assignee: Arun C Murthy
> Fix For: 0.15.3, 0.16.0
>
> Attachments: HADOOP-2574_0_20080110.patch
>
>
> Sam Pullara sends me:
> {noformat}
> Phu was going through the WordCount example... lines 52 and 53 should have args[0] and args[1]:
> http://lucene.apache.org/hadoop/docs/current/mapred_tutorial.html
> The javac and jar command are also wrong, they don't include the directories for the packages, should be:
> $ javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d classes WordCount.java
> $ jar -cvf /usr/joe/wordcount.jar WordCount.class -C classes .
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2574) bugs in mapred tutorial
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated HADOOP-2574:
----------------------------------
Status: Open (was: Patch Available)
Uh, I missed:
bq. The quickstart tutorial does not make it clear which examples work under which scenarios (Stand alone, Pseudo-Distributed, or Fully-Distributed).
> bugs in mapred tutorial
> -----------------------
>
> Key: HADOOP-2574
> URL: https://issues.apache.org/jira/browse/HADOOP-2574
> Project: Hadoop
> Issue Type: Bug
> Components: documentation
> Reporter: Doug Cutting
> Assignee: Arun C Murthy
> Fix For: 0.15.3, 0.16.0
>
> Attachments: HADOOP-2574_0_20080110.patch, mapred_tutorial.html
>
>
> Sam Pullara sends me:
> {noformat}
> Phu was going through the WordCount example... lines 52 and 53 should have args[0] and args[1]:
> http://lucene.apache.org/hadoop/docs/current/mapred_tutorial.html
> The javac and jar command are also wrong, they don't include the directories for the packages, should be:
> $ javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d classes WordCount.java
> $ jar -cvf /usr/joe/wordcount.jar WordCount.class -C classes .
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2574) bugs in mapred tutorial
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated HADOOP-2574:
----------------------------------
Attachment: HADOOP-2574_0_20080110.patch
Here is patch which addresses most of Phu's concerns...
> bugs in mapred tutorial
> -----------------------
>
> Key: HADOOP-2574
> URL: https://issues.apache.org/jira/browse/HADOOP-2574
> Project: Hadoop
> Issue Type: Bug
> Components: documentation
> Reporter: Doug Cutting
> Assignee: Arun C Murthy
> Fix For: 0.15.3, 0.16.0
>
> Attachments: HADOOP-2574_0_20080110.patch
>
>
> Sam Pullara sends me:
> {noformat}
> Phu was going through the WordCount example... lines 52 and 53 should have args[0] and args[1]:
> http://lucene.apache.org/hadoop/docs/current/mapred_tutorial.html
> The javac and jar command are also wrong, they don't include the directories for the packages, should be:
> $ javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d classes WordCount.java
> $ jar -cvf /usr/joe/wordcount.jar WordCount.class -C classes .
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2574) bugs in mapred tutorial
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12558522#action_12558522 ]
Amar Kamat commented on HADOOP-2574:
------------------------------------
+1. I tried running the wordcount-v2 line by line and now it works fine. Just a small suggestions, in the last example of wordcount v2 (case sensitive = true/false), could you make the distinction evident by having {{Hello}} and {{hello}} in the input file.
> bugs in mapred tutorial
> -----------------------
>
> Key: HADOOP-2574
> URL: https://issues.apache.org/jira/browse/HADOOP-2574
> Project: Hadoop
> Issue Type: Bug
> Components: documentation
> Reporter: Doug Cutting
> Assignee: Arun C Murthy
> Fix For: 0.15.3, 0.16.0
>
> Attachments: HADOOP-2574_0_20080110.patch, mapred_tutorial.html
>
>
> Sam Pullara sends me:
> {noformat}
> Phu was going through the WordCount example... lines 52 and 53 should have args[0] and args[1]:
> http://lucene.apache.org/hadoop/docs/current/mapred_tutorial.html
> The javac and jar command are also wrong, they don't include the directories for the packages, should be:
> $ javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d classes WordCount.java
> $ jar -cvf /usr/joe/wordcount.jar WordCount.class -C classes .
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2574) bugs in mapred tutorial
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated HADOOP-2574:
----------------------------------
Attachment: mapred_tutorial.html
HADOOP-2574_1_20080114.patch
Updated to incorporate Phu's original ask and Amar's feedback... again, I've attached the generate mapred_tutorial.html for folks to review it without having to figure forrest.
> bugs in mapred tutorial
> -----------------------
>
> Key: HADOOP-2574
> URL: https://issues.apache.org/jira/browse/HADOOP-2574
> Project: Hadoop
> Issue Type: Bug
> Components: documentation
> Reporter: Doug Cutting
> Assignee: Arun C Murthy
> Fix For: 0.15.3
>
> Attachments: HADOOP-2574_0_20080110.patch, HADOOP-2574_1_20080114.patch, mapred_tutorial.html, mapred_tutorial.html
>
>
> Sam Pullara sends me:
> {noformat}
> Phu was going through the WordCount example... lines 52 and 53 should have args[0] and args[1]:
> http://lucene.apache.org/hadoop/docs/current/mapred_tutorial.html
> The javac and jar command are also wrong, they don't include the directories for the packages, should be:
> $ javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d classes WordCount.java
> $ jar -cvf /usr/joe/wordcount.jar WordCount.class -C classes .
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2574) bugs in mapred tutorial
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12558569#action_12558569 ]
Arun C Murthy commented on HADOOP-2574:
---------------------------------------
Phu - does this patch (http://issues.apache.org/jira/secure/attachment/12373083/mapred_tutorial.html) address your concerns?
> bugs in mapred tutorial
> -----------------------
>
> Key: HADOOP-2574
> URL: https://issues.apache.org/jira/browse/HADOOP-2574
> Project: Hadoop
> Issue Type: Bug
> Components: documentation
> Reporter: Doug Cutting
> Assignee: Arun C Murthy
> Fix For: 0.15.3
>
> Attachments: HADOOP-2574_0_20080110.patch, HADOOP-2574_1_20080114.patch, mapred_tutorial.html, mapred_tutorial.html
>
>
> Sam Pullara sends me:
> {noformat}
> Phu was going through the WordCount example... lines 52 and 53 should have args[0] and args[1]:
> http://lucene.apache.org/hadoop/docs/current/mapred_tutorial.html
> The javac and jar command are also wrong, they don't include the directories for the packages, should be:
> $ javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d classes WordCount.java
> $ jar -cvf /usr/joe/wordcount.jar WordCount.class -C classes .
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2574) bugs in mapred tutorial
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12558555#action_12558555 ]
Amar Kamat commented on HADOOP-2574:
------------------------------------
+1
> bugs in mapred tutorial
> -----------------------
>
> Key: HADOOP-2574
> URL: https://issues.apache.org/jira/browse/HADOOP-2574
> Project: Hadoop
> Issue Type: Bug
> Components: documentation
> Reporter: Doug Cutting
> Assignee: Arun C Murthy
> Fix For: 0.15.3
>
> Attachments: HADOOP-2574_0_20080110.patch, HADOOP-2574_1_20080114.patch, mapred_tutorial.html, mapred_tutorial.html
>
>
> Sam Pullara sends me:
> {noformat}
> Phu was going through the WordCount example... lines 52 and 53 should have args[0] and args[1]:
> http://lucene.apache.org/hadoop/docs/current/mapred_tutorial.html
> The javac and jar command are also wrong, they don't include the directories for the packages, should be:
> $ javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d classes WordCount.java
> $ jar -cvf /usr/joe/wordcount.jar WordCount.class -C classes .
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2574) bugs in mapred tutorial
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12558741#action_12558741 ]
Hadoop QA commented on HADOOP-2574:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12373082/HADOOP-2574_1_20080114.patch
against trunk revision r611760.
@author +1. The patch does not contain any @author tags.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new compiler warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
contrib tests -1. The patch failed contrib unit tests.
Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1584/testReport/
Findbugs warnings: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1584/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1584/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1584/console
This message is automatically generated.
> bugs in mapred tutorial
> -----------------------
>
> Key: HADOOP-2574
> URL: https://issues.apache.org/jira/browse/HADOOP-2574
> Project: Hadoop
> Issue Type: Bug
> Components: documentation
> Reporter: Doug Cutting
> Assignee: Arun C Murthy
> Fix For: 0.15.3
>
> Attachments: HADOOP-2574_0_20080110.patch, HADOOP-2574_1_20080114.patch, mapred_tutorial.html, mapred_tutorial.html
>
>
> Sam Pullara sends me:
> {noformat}
> Phu was going through the WordCount example... lines 52 and 53 should have args[0] and args[1]:
> http://lucene.apache.org/hadoop/docs/current/mapred_tutorial.html
> The javac and jar command are also wrong, they don't include the directories for the packages, should be:
> $ javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d classes WordCount.java
> $ jar -cvf /usr/joe/wordcount.jar WordCount.class -C classes .
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2574) bugs in mapred tutorial
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated HADOOP-2574:
----------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this.
> bugs in mapred tutorial
> -----------------------
>
> Key: HADOOP-2574
> URL: https://issues.apache.org/jira/browse/HADOOP-2574
> Project: Hadoop
> Issue Type: Bug
> Components: documentation
> Reporter: Doug Cutting
> Assignee: Arun C Murthy
> Fix For: 0.15.3
>
> Attachments: HADOOP-2574_0_20080110.patch, HADOOP-2574_1_20080114.patch, mapred_tutorial.html, mapred_tutorial.html
>
>
> Sam Pullara sends me:
> {noformat}
> Phu was going through the WordCount example... lines 52 and 53 should have args[0] and args[1]:
> http://lucene.apache.org/hadoop/docs/current/mapred_tutorial.html
> The javac and jar command are also wrong, they don't include the directories for the packages, should be:
> $ javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d classes WordCount.java
> $ jar -cvf /usr/joe/wordcount.jar WordCount.class -C classes .
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2574) bugs in mapred tutorial
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12558917#action_12558917 ]
Arun C Murthy commented on HADOOP-2574:
---------------------------------------
I've clarified in the tutorial that WordCount v1 works with local, pseudo-distributed and fully-distributed modes while v2 needs HDFS to be up and running (pseudo-distributed or fully-distributed) - primarily due to the usage of the DistributedCache. Works?
> bugs in mapred tutorial
> -----------------------
>
> Key: HADOOP-2574
> URL: https://issues.apache.org/jira/browse/HADOOP-2574
> Project: Hadoop
> Issue Type: Bug
> Components: documentation
> Reporter: Doug Cutting
> Assignee: Arun C Murthy
> Fix For: 0.15.3
>
> Attachments: HADOOP-2574_0_20080110.patch, HADOOP-2574_1_20080114.patch, mapred_tutorial.html, mapred_tutorial.html
>
>
> Sam Pullara sends me:
> {noformat}
> Phu was going through the WordCount example... lines 52 and 53 should have args[0] and args[1]:
> http://lucene.apache.org/hadoop/docs/current/mapred_tutorial.html
> The javac and jar command are also wrong, they don't include the directories for the packages, should be:
> $ javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d classes WordCount.java
> $ jar -cvf /usr/joe/wordcount.jar WordCount.class -C classes .
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2574) bugs in mapred tutorial
Posted by "Phu Hoang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12558893#action_12558893 ]
Phu Hoang commented on HADOOP-2574:
-----------------------------------
Arun,
the tutorial addresses all the bugs that I encountered. Great job!!
I was not able to detect that you resolved the smaller confusion (not
show stopper) of whether these examples work if you were in stand-
alone mode or not.
I was able to run WordCount v1.0 using local input and output
directories (not HDFS). I was NOT able to run WordCount v2.0 using
local input and output directories, only HDFS input and output
directories work there. It would be good to set the reader's
expectation.
I could see people trying the examples out without doing HDFS first,
and may run into issues with WordCount v2.0.
Phu
> bugs in mapred tutorial
> -----------------------
>
> Key: HADOOP-2574
> URL: https://issues.apache.org/jira/browse/HADOOP-2574
> Project: Hadoop
> Issue Type: Bug
> Components: documentation
> Reporter: Doug Cutting
> Assignee: Arun C Murthy
> Fix For: 0.15.3
>
> Attachments: HADOOP-2574_0_20080110.patch, HADOOP-2574_1_20080114.patch, mapred_tutorial.html, mapred_tutorial.html
>
>
> Sam Pullara sends me:
> {noformat}
> Phu was going through the WordCount example... lines 52 and 53 should have args[0] and args[1]:
> http://lucene.apache.org/hadoop/docs/current/mapred_tutorial.html
> The javac and jar command are also wrong, they don't include the directories for the packages, should be:
> $ javac -classpath ${HADOOP_HOME}/hadoop-${HADOOP_VERSION}-core.jar -d classes WordCount.java
> $ jar -cvf /usr/joe/wordcount.jar WordCount.class -C classes .
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.