You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Tom White (JIRA)" <ji...@apache.org> on 2007/06/29 14:51:04 UTC
[jira] Created: (HADOOP-1547) Provide examples for aggregate
library
Provide examples for aggregate library
--------------------------------------
Key: HADOOP-1547
URL: https://issues.apache.org/jira/browse/HADOOP-1547
Project: Hadoop
Issue Type: Improvement
Components: examples
Reporter: Tom White
Assignee: Runping Qi
The abacus examples were not moved to aggregate when it was created. Provide an aggregate example which shows users how to use the aggregate library.
As a part of this issue move TestAggregates to the org.apache.hadoop.mapred.lib.aggregate package.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1547) Provide examples for aggregate
library
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-1547:
-------------------------------
Attachment: patch_1547.txt
A new patch addressing Tom and Owen's comments attached.
> Provide examples for aggregate library
> --------------------------------------
>
> Key: HADOOP-1547
> URL: https://issues.apache.org/jira/browse/HADOOP-1547
> Project: Hadoop
> Issue Type: Improvement
> Components: examples
> Reporter: Tom White
> Assignee: Runping Qi
> Attachments: patch_1547.txt
>
>
> The abacus examples were not moved to aggregate when it was created. Provide an aggregate example which shows users how to use the aggregate library.
> As a part of this issue move TestAggregates to the org.apache.hadoop.mapred.lib.aggregate package.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1547) Provide examples for aggregate
library
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12512446 ]
Hudson commented on HADOOP-1547:
--------------------------------
Integrated in Hadoop-Nightly #154 (See [http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Nightly/154/])
> Provide examples for aggregate library
> --------------------------------------
>
> Key: HADOOP-1547
> URL: https://issues.apache.org/jira/browse/HADOOP-1547
> Project: Hadoop
> Issue Type: Improvement
> Components: examples
> Reporter: Tom White
> Assignee: Runping Qi
> Fix For: 0.14.0
>
> Attachments: patch_1547.txt
>
>
> The abacus examples were not moved to aggregate when it was created. Provide an aggregate example which shows users how to use the aggregate library.
> As a part of this issue move TestAggregates to the org.apache.hadoop.mapred.lib.aggregate package.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1547) Provide examples for aggregate
library
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12511273 ]
Hadoop QA commented on HADOOP-1547:
-----------------------------------
+1
http://issues.apache.org/jira/secure/attachment/12361439/patch_1547.txt applied and successfully tested against trunk revision r554144.
Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/379/testReport/
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/379/console
> Provide examples for aggregate library
> --------------------------------------
>
> Key: HADOOP-1547
> URL: https://issues.apache.org/jira/browse/HADOOP-1547
> Project: Hadoop
> Issue Type: Improvement
> Components: examples
> Reporter: Tom White
> Assignee: Runping Qi
> Attachments: patch_1547.txt
>
>
> The abacus examples were not moved to aggregate when it was created. Provide an aggregate example which shows users how to use the aggregate library.
> As a part of this issue move TestAggregates to the org.apache.hadoop.mapred.lib.aggregate package.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1547) Provide examples for aggregate
library
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12511773 ]
Runping Qi commented on HADOOP-1547:
------------------------------------
I hope this patch can get in the next release.
Let me know if there are any concerns for committing it.
> Provide examples for aggregate library
> --------------------------------------
>
> Key: HADOOP-1547
> URL: https://issues.apache.org/jira/browse/HADOOP-1547
> Project: Hadoop
> Issue Type: Improvement
> Components: examples
> Reporter: Tom White
> Assignee: Runping Qi
> Attachments: patch_1547.txt
>
>
> The abacus examples were not moved to aggregate when it was created. Provide an aggregate example which shows users how to use the aggregate library.
> As a part of this issue move TestAggregates to the org.apache.hadoop.mapred.lib.aggregate package.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1547) Provide examples for aggregate
library
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated HADOOP-1547:
------------------------------
Resolution: Fixed
Fix Version/s: 0.14.0
Status: Resolved (was: Patch Available)
I've just committed this. Thanks Runping!
I made a further minor change to the usage javadoc.
> Provide examples for aggregate library
> --------------------------------------
>
> Key: HADOOP-1547
> URL: https://issues.apache.org/jira/browse/HADOOP-1547
> Project: Hadoop
> Issue Type: Improvement
> Components: examples
> Reporter: Tom White
> Assignee: Runping Qi
> Fix For: 0.14.0
>
> Attachments: patch_1547.txt
>
>
> The abacus examples were not moved to aggregate when it was created. Provide an aggregate example which shows users how to use the aggregate library.
> As a part of this issue move TestAggregates to the org.apache.hadoop.mapred.lib.aggregate package.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1547) Provide examples for aggregate
library
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-1547:
-------------------------------
Attachment: (was: patch_1547.txt)
> Provide examples for aggregate library
> --------------------------------------
>
> Key: HADOOP-1547
> URL: https://issues.apache.org/jira/browse/HADOOP-1547
> Project: Hadoop
> Issue Type: Improvement
> Components: examples
> Reporter: Tom White
> Assignee: Runping Qi
>
> The abacus examples were not moved to aggregate when it was created. Provide an aggregate example which shows users how to use the aggregate library.
> As a part of this issue move TestAggregates to the org.apache.hadoop.mapred.lib.aggregate package.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1547) Provide examples for aggregate
library
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12512269 ]
Hadoop QA commented on HADOOP-1547:
-----------------------------------
-1, could not apply patch.
The patch command could not apply the latest attachment http://issues.apache.org/jira/secure/attachment/12361701/patch_1547.txt as a patch to trunk revision r555770.
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/401/console
Please note that this message is automatically generated and may represent a problem with the automation system and not the patch.
> Provide examples for aggregate library
> --------------------------------------
>
> Key: HADOOP-1547
> URL: https://issues.apache.org/jira/browse/HADOOP-1547
> Project: Hadoop
> Issue Type: Improvement
> Components: examples
> Reporter: Tom White
> Assignee: Runping Qi
> Fix For: 0.14.0
>
> Attachments: patch_1547.txt
>
>
> The abacus examples were not moved to aggregate when it was created. Provide an aggregate example which shows users how to use the aggregate library.
> As a part of this issue move TestAggregates to the org.apache.hadoop.mapred.lib.aggregate package.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1547) Provide examples for aggregate
library
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-1547:
-------------------------------
Status: Patch Available (was: Open)
> Provide examples for aggregate library
> --------------------------------------
>
> Key: HADOOP-1547
> URL: https://issues.apache.org/jira/browse/HADOOP-1547
> Project: Hadoop
> Issue Type: Improvement
> Components: examples
> Reporter: Tom White
> Assignee: Runping Qi
> Attachments: patch_1547.txt
>
>
> The abacus examples were not moved to aggregate when it was created. Provide an aggregate example which shows users how to use the aggregate library.
> As a part of this issue move TestAggregates to the org.apache.hadoop.mapred.lib.aggregate package.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1547) Provide examples for aggregate
library
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-1547:
----------------------------------
Status: Open (was: Patch Available)
Runping, can you please reformat the patch to stay within 80 characters?
> Provide examples for aggregate library
> --------------------------------------
>
> Key: HADOOP-1547
> URL: https://issues.apache.org/jira/browse/HADOOP-1547
> Project: Hadoop
> Issue Type: Improvement
> Components: examples
> Reporter: Tom White
> Assignee: Runping Qi
> Attachments: patch_1547.txt
>
>
> The abacus examples were not moved to aggregate when it was created. Provide an aggregate example which shows users how to use the aggregate library.
> As a part of this issue move TestAggregates to the org.apache.hadoop.mapred.lib.aggregate package.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1547) Provide examples for aggregate
library
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-1547:
-------------------------------
Attachment: patch_1547.txt
This patch addresses the following issues:
1. Move the TestAggregate to mapred.lib.aggregate package.
2. Provide an example in the examples dir.
The example is to use Aggregate to count the word occurrences in the input files.
3. Replace work Abacus in the comments in the source files with Aggregate
4. Modify the ValueAggregatorJob so that it allows the user to specify a user jar file
in the spec file under attribute anme "user.jar.file".
This makes Aggregate package work without depending on HADOOP-1521
> Provide examples for aggregate library
> --------------------------------------
>
> Key: HADOOP-1547
> URL: https://issues.apache.org/jira/browse/HADOOP-1547
> Project: Hadoop
> Issue Type: Improvement
> Components: examples
> Reporter: Tom White
> Assignee: Runping Qi
> Attachments: patch_1547.txt
>
>
> The abacus examples were not moved to aggregate when it was created. Provide an aggregate example which shows users how to use the aggregate library.
> As a part of this issue move TestAggregates to the org.apache.hadoop.mapred.lib.aggregate package.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-1547) Provide examples for aggregate
library
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-1547:
-------------------------------
Status: Patch Available (was: Open)
> Provide examples for aggregate library
> --------------------------------------
>
> Key: HADOOP-1547
> URL: https://issues.apache.org/jira/browse/HADOOP-1547
> Project: Hadoop
> Issue Type: Improvement
> Components: examples
> Reporter: Tom White
> Assignee: Runping Qi
> Attachments: patch_1547.txt
>
>
> The abacus examples were not moved to aggregate when it was created. Provide an aggregate example which shows users how to use the aggregate library.
> As a part of this issue move TestAggregates to the org.apache.hadoop.mapred.lib.aggregate package.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-1547) Provide examples for aggregate
library
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12512165 ]
Tom White commented on HADOOP-1547:
-----------------------------------
Runping, please also update the usage line in the javadoc of AggregateWordCount to include
{noformat}
1 textinputformat
{noformat}
to specify the number of reducers and the type of input. When I tried omitting these I got an exception.
> Provide examples for aggregate library
> --------------------------------------
>
> Key: HADOOP-1547
> URL: https://issues.apache.org/jira/browse/HADOOP-1547
> Project: Hadoop
> Issue Type: Improvement
> Components: examples
> Reporter: Tom White
> Assignee: Runping Qi
> Attachments: patch_1547.txt
>
>
> The abacus examples were not moved to aggregate when it was created. Provide an aggregate example which shows users how to use the aggregate library.
> As a part of this issue move TestAggregates to the org.apache.hadoop.mapred.lib.aggregate package.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.