You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Skye Wanderman-Milne (JIRA)" <ji...@apache.org> on 2012/11/22 02:38:58 UTC
[jira] [Created] (AVRO-1211) Add MR guide to documentation
Skye Wanderman-Milne created AVRO-1211:
------------------------------------------
Summary: Add MR guide to documentation
Key: AVRO-1211
URL: https://issues.apache.org/jira/browse/AVRO-1211
Project: Avro
Issue Type: Improvement
Components: doc
Affects Versions: 1.7.2
Reporter: Skye Wanderman-Milne
Assignee: Skye Wanderman-Milne
Fix For: 1.7.3
Let's write more Avro documentation! This time we'll do a MapReduce example.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AVRO-1211) Add MR guide to documentation
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13505959#comment-13505959 ]
Doug Cutting commented on AVRO-1211:
------------------------------------
This looks great!
We might also link to the following page for more details on configuring Avro MR jobs:
http://avro.apache.org/docs/current/api/java/org/apache/avro/mapred/package-summary.html
Also we should package the examples into the release. Perhaps the easiest way would be to change the "doc" target in doc/build.xml to copy these files into ${build.dir}/examples.
> Add MR guide to documentation
> -----------------------------
>
> Key: AVRO-1211
> URL: https://issues.apache.org/jira/browse/AVRO-1211
> Project: Avro
> Issue Type: Improvement
> Components: doc
> Affects Versions: 1.7.2
> Reporter: Skye Wanderman-Milne
> Assignee: Skye Wanderman-Milne
> Labels: docs
> Fix For: 1.7.3
>
> Attachments: AVRO-1211.1.patch, AVRO-1211.1.tar.gz, mr-example.tar.gz
>
>
> Let's write more Avro documentation! This time we'll do a MapReduce example.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-1211) Add MR guide to documentation
Posted by "Skye Wanderman-Milne (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Skye Wanderman-Milne updated AVRO-1211:
---------------------------------------
Attachment: AVRO-1211.1.tar.gz
AVRO-1211.1.patch
I went ahead and wrote page going over avro-mapred and the example (which has a couple small changes but nothing major). Any feedback is appreciated.
> Add MR guide to documentation
> -----------------------------
>
> Key: AVRO-1211
> URL: https://issues.apache.org/jira/browse/AVRO-1211
> Project: Avro
> Issue Type: Improvement
> Components: doc
> Affects Versions: 1.7.2
> Reporter: Skye Wanderman-Milne
> Assignee: Skye Wanderman-Milne
> Labels: docs
> Fix For: 1.7.3
>
> Attachments: AVRO-1211.1.patch, AVRO-1211.1.tar.gz, mr-example.tar.gz
>
>
> Let's write more Avro documentation! This time we'll do a MapReduce example.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Work started] (AVRO-1211) Add MR guide to documentation
Posted by "Skye Wanderman-Milne (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Work on AVRO-1211 started by Skye Wanderman-Milne.
> Add MR guide to documentation
> -----------------------------
>
> Key: AVRO-1211
> URL: https://issues.apache.org/jira/browse/AVRO-1211
> Project: Avro
> Issue Type: Improvement
> Components: doc
> Affects Versions: 1.7.2
> Reporter: Skye Wanderman-Milne
> Assignee: Skye Wanderman-Milne
> Labels: docs
> Fix For: 1.7.3
>
>
> Let's write more Avro documentation! This time we'll do a MapReduce example.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-1211) Add MR guide to documentation
Posted by "Skye Wanderman-Milne (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Skye Wanderman-Milne updated AVRO-1211:
---------------------------------------
Attachment: mr-example.tar.gz
I'm in the process of writing a Avro + MR guide (similar to the getting started guides). I haven't written the actual documentation yet but here's the example maven project I created. It would be great if someone could check that I'm following all best practices, etc. (Check out mr-example/src/main/java/example/ColorCount.java for the actual MR example.)
> Add MR guide to documentation
> -----------------------------
>
> Key: AVRO-1211
> URL: https://issues.apache.org/jira/browse/AVRO-1211
> Project: Avro
> Issue Type: Improvement
> Components: doc
> Affects Versions: 1.7.2
> Reporter: Skye Wanderman-Milne
> Assignee: Skye Wanderman-Milne
> Labels: docs
> Fix For: 1.7.3
>
> Attachments: mr-example.tar.gz
>
>
> Let's write more Avro documentation! This time we'll do a MapReduce example.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-1211) Add MR guide to documentation
Posted by "Skye Wanderman-Milne (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Skye Wanderman-Milne updated AVRO-1211:
---------------------------------------
Attachment: AVRO-1211.2.tar.gz
AVRO-1211.2.patch
I rewrote the example and guide to use AvroMapper and AvroReducer (somehow I missed these when I first wrote the example, oops). I also included an example of writing a Reducer that outputs Avro (AvroWordCount), but only mention it in the guide without going in-depth, as well as link to http://avro.apache.org/docs/current/api/java/org/apache/avro/mapred/package-summary.html and http://avro.apache.org/docs/current/api/java/org/apache/avro/mapreduce/package-summary.html.
I'm not super familiar with Maven so if someone else could edit doc/build.xml that'd be great.
> Add MR guide to documentation
> -----------------------------
>
> Key: AVRO-1211
> URL: https://issues.apache.org/jira/browse/AVRO-1211
> Project: Avro
> Issue Type: Improvement
> Components: doc
> Affects Versions: 1.7.2
> Reporter: Skye Wanderman-Milne
> Assignee: Skye Wanderman-Milne
> Labels: docs
> Fix For: 1.7.3
>
> Attachments: AVRO-1211.1.patch, AVRO-1211.1.tar.gz, AVRO-1211.2.patch, AVRO-1211.2.tar.gz, mr-example.tar.gz
>
>
> Let's write more Avro documentation! This time we'll do a MapReduce example.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira