You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Ashish Nagavaram (JIRA)" <ji...@apache.org> on 2012/06/02 02:19:23 UTC
[jira] [Created] (AVRO-1108) AvroReflectOutput for new Avro hadoop
version
Ashish Nagavaram created AVRO-1108:
--------------------------------------
Summary: AvroReflectOutput for new Avro hadoop version
Key: AVRO-1108
URL: https://issues.apache.org/jira/browse/AVRO-1108
Project: Avro
Issue Type: New Feature
Components: java
Affects Versions: 1.7.1
Reporter: Ashish Nagavaram
Assignee: Ashish Nagavaram
Fix For: 1.7.1
Create a outputformat for supporting AvroReflectOutputFormat to write Reflection data to file for the new Hadoop version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AVRO-1108) AvroReflectOutput for new Avro
hadoop version
Posted by "Ashish Nagavaram (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295887#comment-13295887 ]
Ashish Nagavaram commented on AVRO-1108:
----------------------------------------
Hi Doug, I didn't have a chance to test it (was busy with some other work). Since all the test cases pass I think it should be fine.
> AvroReflectOutput for new Avro hadoop version
> ---------------------------------------------
>
> Key: AVRO-1108
> URL: https://issues.apache.org/jira/browse/AVRO-1108
> Project: Avro
> Issue Type: New Feature
> Components: java
> Affects Versions: 1.7.1
> Reporter: Ashish Nagavaram
> Assignee: Ashish Nagavaram
> Fix For: 1.7.1
>
> Attachments: AVRO-1108.patch, AVRO-1108.patch
>
>
> Create a outputformat for supporting AvroReflectOutputFormat to write Reflection data to file for the new Hadoop version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-1108) AvroReflectOutput for new Avro hadoop
version
Posted by "Ashish Nagavaram (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashish Nagavaram updated AVRO-1108:
-----------------------------------
Due Date: (was: 8/Jun/12)
> AvroReflectOutput for new Avro hadoop version
> ---------------------------------------------
>
> Key: AVRO-1108
> URL: https://issues.apache.org/jira/browse/AVRO-1108
> Project: Avro
> Issue Type: New Feature
> Components: java
> Affects Versions: 1.7.1
> Reporter: Ashish Nagavaram
> Assignee: Ashish Nagavaram
> Fix For: 1.7.1
>
>
> Create a outputformat for supporting AvroReflectOutputFormat to write Reflection data to file for the new Hadoop version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-1108) AvroReflectOutput for new Avro hadoop
version
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Doug Cutting updated AVRO-1108:
-------------------------------
Attachment: AVRO-1108.patch
Rather than duplicating existing code, I think we can simply change it to specify reflect instead of specific, since specific is a subset of reflect. Here's a patch that does that. Does this work for you?
> AvroReflectOutput for new Avro hadoop version
> ---------------------------------------------
>
> Key: AVRO-1108
> URL: https://issues.apache.org/jira/browse/AVRO-1108
> Project: Avro
> Issue Type: New Feature
> Components: java
> Affects Versions: 1.7.1
> Reporter: Ashish Nagavaram
> Assignee: Ashish Nagavaram
> Fix For: 1.7.1
>
> Attachments: AVRO-1108.patch, AVRO-1108.patch
>
>
> Create a outputformat for supporting AvroReflectOutputFormat to write Reflection data to file for the new Hadoop version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-1108) AvroReflectOutput for new Avro hadoop
version
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Doug Cutting updated AVRO-1108:
-------------------------------
Resolution: Fixed
Assignee: Doug Cutting (was: Ashish Nagavaram)
Status: Resolved (was: Patch Available)
I added some tests and committed this.
> AvroReflectOutput for new Avro hadoop version
> ---------------------------------------------
>
> Key: AVRO-1108
> URL: https://issues.apache.org/jira/browse/AVRO-1108
> Project: Avro
> Issue Type: New Feature
> Components: java
> Affects Versions: 1.7.1
> Reporter: Ashish Nagavaram
> Assignee: Doug Cutting
> Fix For: 1.7.1
>
> Attachments: AVRO-1108.patch, AVRO-1108.patch
>
>
> Create a outputformat for supporting AvroReflectOutputFormat to write Reflection data to file for the new Hadoop version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AVRO-1108) AvroReflectOutput for new Avro
hadoop version
Posted by "Ashish Nagavaram (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293772#comment-13293772 ]
Ashish Nagavaram commented on AVRO-1108:
----------------------------------------
Sure, works for me. This would be more efficient too. I am not sure if all the test cases will pass with this change, I will apply the patch and try running them.
> AvroReflectOutput for new Avro hadoop version
> ---------------------------------------------
>
> Key: AVRO-1108
> URL: https://issues.apache.org/jira/browse/AVRO-1108
> Project: Avro
> Issue Type: New Feature
> Components: java
> Affects Versions: 1.7.1
> Reporter: Ashish Nagavaram
> Assignee: Ashish Nagavaram
> Fix For: 1.7.1
>
> Attachments: AVRO-1108.patch, AVRO-1108.patch
>
>
> Create a outputformat for supporting AvroReflectOutputFormat to write Reflection data to file for the new Hadoop version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-1108) AvroReflectOutput for new Avro hadoop
version
Posted by "Ashish Nagavaram (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashish Nagavaram updated AVRO-1108:
-----------------------------------
Status: Patch Available (was: Open)
> AvroReflectOutput for new Avro hadoop version
> ---------------------------------------------
>
> Key: AVRO-1108
> URL: https://issues.apache.org/jira/browse/AVRO-1108
> Project: Avro
> Issue Type: New Feature
> Components: java
> Affects Versions: 1.7.1
> Reporter: Ashish Nagavaram
> Assignee: Ashish Nagavaram
> Fix For: 1.7.1
>
> Attachments: AVRO-1108.patch
>
>
> Create a outputformat for supporting AvroReflectOutputFormat to write Reflection data to file for the new Hadoop version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-1108) AvroReflectOutput for new Avro hadoop
version
Posted by "Ashish Nagavaram (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashish Nagavaram updated AVRO-1108:
-----------------------------------
Attachment: AVRO-1108.patch
Patch containing a library for allowing writes of Reflect data to files. We can also write some meta-data to the output files. The Meta Data can be either Text or Binary.
> AvroReflectOutput for new Avro hadoop version
> ---------------------------------------------
>
> Key: AVRO-1108
> URL: https://issues.apache.org/jira/browse/AVRO-1108
> Project: Avro
> Issue Type: New Feature
> Components: java
> Affects Versions: 1.7.1
> Reporter: Ashish Nagavaram
> Assignee: Ashish Nagavaram
> Fix For: 1.7.1
>
> Attachments: AVRO-1108.patch
>
>
> Create a outputformat for supporting AvroReflectOutputFormat to write Reflection data to file for the new Hadoop version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-1108) AvroReflectOutput for new Avro hadoop
version
Posted by "Ashish Nagavaram (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashish Nagavaram updated AVRO-1108:
-----------------------------------
Status: Patch Available (was: In Progress)
> AvroReflectOutput for new Avro hadoop version
> ---------------------------------------------
>
> Key: AVRO-1108
> URL: https://issues.apache.org/jira/browse/AVRO-1108
> Project: Avro
> Issue Type: New Feature
> Components: java
> Affects Versions: 1.7.1
> Reporter: Ashish Nagavaram
> Assignee: Ashish Nagavaram
> Fix For: 1.7.1
>
>
> Create a outputformat for supporting AvroReflectOutputFormat to write Reflection data to file for the new Hadoop version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (AVRO-1108) AvroReflectOutput for new Avro
hadoop version
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295851#comment-13295851 ]
Doug Cutting commented on AVRO-1108:
------------------------------------
Ashish, have you had a chance to test this? All existing tests pass for me.
Unless there are objections, I'll commit it soon.
> AvroReflectOutput for new Avro hadoop version
> ---------------------------------------------
>
> Key: AVRO-1108
> URL: https://issues.apache.org/jira/browse/AVRO-1108
> Project: Avro
> Issue Type: New Feature
> Components: java
> Affects Versions: 1.7.1
> Reporter: Ashish Nagavaram
> Assignee: Ashish Nagavaram
> Fix For: 1.7.1
>
> Attachments: AVRO-1108.patch, AVRO-1108.patch
>
>
> Create a outputformat for supporting AvroReflectOutputFormat to write Reflection data to file for the new Hadoop version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Work started] (AVRO-1108) AvroReflectOutput for new Avro
hadoop version
Posted by "Ashish Nagavaram (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Work on AVRO-1108 started by Ashish Nagavaram.
> AvroReflectOutput for new Avro hadoop version
> ---------------------------------------------
>
> Key: AVRO-1108
> URL: https://issues.apache.org/jira/browse/AVRO-1108
> Project: Avro
> Issue Type: New Feature
> Components: java
> Affects Versions: 1.7.1
> Reporter: Ashish Nagavaram
> Assignee: Ashish Nagavaram
> Fix For: 1.7.1
>
>
> Create a outputformat for supporting AvroReflectOutputFormat to write Reflection data to file for the new Hadoop version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (AVRO-1108) AvroReflectOutput for new Avro hadoop
version
Posted by "Ashish Nagavaram (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/AVRO-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashish Nagavaram updated AVRO-1108:
-----------------------------------
Status: Open (was: Patch Available)
> AvroReflectOutput for new Avro hadoop version
> ---------------------------------------------
>
> Key: AVRO-1108
> URL: https://issues.apache.org/jira/browse/AVRO-1108
> Project: Avro
> Issue Type: New Feature
> Components: java
> Affects Versions: 1.7.1
> Reporter: Ashish Nagavaram
> Assignee: Ashish Nagavaram
> Fix For: 1.7.1
>
>
> Create a outputformat for supporting AvroReflectOutputFormat to write Reflection data to file for the new Hadoop version.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira