You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Doug Cutting (JIRA)" <ji...@apache.org> on 2010/11/19 00:55:13 UTC
[jira] Created: (AVRO-698) add mapred tests that incorporate
non-Avro formats
add mapred tests that incorporate non-Avro formats
--------------------------------------------------
Key: AVRO-698
URL: https://issues.apache.org/jira/browse/AVRO-698
Project: Avro
Issue Type: Test
Components: java
Reporter: Doug Cutting
Assignee: Doug Cutting
Fix For: 1.5.0
It would be good to have some test MapReduce jobs that:
- accept Avro input and produces non-Avro (e.g., text) output
- accept non-Avro input (e.g., text) and generates Avro output
These would both ensure that the APIs make this easy (since several folks have asked about this) as well as provide examples for those who need to do this. This might also identify some API and documentation improvements.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (AVRO-698) add mapred tests that incorporate
non-Avro formats
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Doug Cutting updated AVRO-698:
------------------------------
Status: Patch Available (was: Open)
> add mapred tests that incorporate non-Avro formats
> --------------------------------------------------
>
> Key: AVRO-698
> URL: https://issues.apache.org/jira/browse/AVRO-698
> Project: Avro
> Issue Type: Test
> Components: java
> Reporter: Doug Cutting
> Assignee: Doug Cutting
> Fix For: 1.5.0
>
> Attachments: AVRO-698.patch
>
>
> It would be good to have some test MapReduce jobs that:
> - accept Avro input and produces non-Avro (e.g., text) output
> - accept non-Avro input (e.g., text) and generates Avro output
> These would both ensure that the APIs make this easy (since several folks have asked about this) as well as provide examples for those who need to do this. This might also identify some API and documentation improvements.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (AVRO-698) add mapred tests that incorporate
non-Avro formats
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Doug Cutting updated AVRO-698:
------------------------------
Attachment: AVRO-698.patch
Here's a new version of the patch that updates the documentation too.
If there are no objections, I will commit this.
> add mapred tests that incorporate non-Avro formats
> --------------------------------------------------
>
> Key: AVRO-698
> URL: https://issues.apache.org/jira/browse/AVRO-698
> Project: Avro
> Issue Type: Test
> Components: java
> Reporter: Doug Cutting
> Assignee: Doug Cutting
> Fix For: 1.5.0
>
> Attachments: AVRO-698.patch, AVRO-698.patch
>
>
> It would be good to have some test MapReduce jobs that:
> - accept Avro input and produces non-Avro (e.g., text) output
> - accept non-Avro input (e.g., text) and generates Avro output
> These would both ensure that the APIs make this easy (since several folks have asked about this) as well as provide examples for those who need to do this. This might also identify some API and documentation improvements.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (AVRO-698) add mapred tests that incorporate
non-Avro formats
Posted by "Scott Carey (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12934984#action_12934984 ]
Scott Carey commented on AVRO-698:
----------------------------------
+1 Looks good in a quick review.
> add mapred tests that incorporate non-Avro formats
> --------------------------------------------------
>
> Key: AVRO-698
> URL: https://issues.apache.org/jira/browse/AVRO-698
> Project: Avro
> Issue Type: Test
> Components: java
> Reporter: Doug Cutting
> Assignee: Doug Cutting
> Fix For: 1.5.0
>
> Attachments: AVRO-698.patch, AVRO-698.patch
>
>
> It would be good to have some test MapReduce jobs that:
> - accept Avro input and produces non-Avro (e.g., text) output
> - accept non-Avro input (e.g., text) and generates Avro output
> These would both ensure that the APIs make this easy (since several folks have asked about this) as well as provide examples for those who need to do this. This might also identify some API and documentation improvements.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (AVRO-698) add mapred tests that incorporate
non-Avro formats
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Doug Cutting updated AVRO-698:
------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I just committed this.
> add mapred tests that incorporate non-Avro formats
> --------------------------------------------------
>
> Key: AVRO-698
> URL: https://issues.apache.org/jira/browse/AVRO-698
> Project: Avro
> Issue Type: Test
> Components: java
> Reporter: Doug Cutting
> Assignee: Doug Cutting
> Fix For: 1.5.0
>
> Attachments: AVRO-698.patch, AVRO-698.patch
>
>
> It would be good to have some test MapReduce jobs that:
> - accept Avro input and produces non-Avro (e.g., text) output
> - accept non-Avro input (e.g., text) and generates Avro output
> These would both ensure that the APIs make this easy (since several folks have asked about this) as well as provide examples for those who need to do this. This might also identify some API and documentation improvements.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (AVRO-698) add mapred tests that incorporate
non-Avro formats
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Doug Cutting updated AVRO-698:
------------------------------
Attachment: AVRO-698.patch
Here's a patch that adds some test cases and makes it easier to configure jobs that use:
- Avro input and mapper with normal Hadoop reducer and output
- normal Hadoop input and mapper with Avro reducer and output
> add mapred tests that incorporate non-Avro formats
> --------------------------------------------------
>
> Key: AVRO-698
> URL: https://issues.apache.org/jira/browse/AVRO-698
> Project: Avro
> Issue Type: Test
> Components: java
> Reporter: Doug Cutting
> Assignee: Doug Cutting
> Fix For: 1.5.0
>
> Attachments: AVRO-698.patch
>
>
> It would be good to have some test MapReduce jobs that:
> - accept Avro input and produces non-Avro (e.g., text) output
> - accept non-Avro input (e.g., text) and generates Avro output
> These would both ensure that the APIs make this easy (since several folks have asked about this) as well as provide examples for those who need to do this. This might also identify some API and documentation improvements.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.