You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Cheolsoo Park (JIRA)" <ji...@apache.org> on 2012/08/02 00:15:04 UTC
[jira] [Created] (PIG-2854) AvroStorage doesn't work with Avro
1.7.1
Cheolsoo Park created PIG-2854:
----------------------------------
Summary: AvroStorage doesn't work with Avro 1.7.1
Key: PIG-2854
URL: https://issues.apache.org/jira/browse/PIG-2854
Project: Pig
Issue Type: Bug
Components: piggybank
Affects Versions: 0.10.0
Reporter: Cheolsoo Park
Assignee: Cheolsoo Park
PigAvroDatumWriter fails to compile against Avro 1.7.1 with the following error:
{code}
/home/cheolsoo/workspace/pig-trunk/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/PigAvroDatumWriter.java:119: resolveUnion(org.apache.avro.Schema,java.lang.Object) in org.apache.pig.piggybank.storage.avro.PigAvroDatumWriter cannot override resolveUnion(org.apache.avro.Schema,java.lang.Object) in org.apache.avro.generic.GenericDatumWriter; overridden method does not throw java.io.IOException
protected int resolveUnion(Schema union, Object datum) throws IOException {
{code}
The problem is that a new method resolveUnion() is added to GenericDatumWriter in Avro 1.6.x and 1.7.x, but this method conflicts with the one that already exists in PigAvroDatatumWriter.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2854) AvroStorage doesn't work with Avro
1.7.1
Posted by "Santhosh Srinivasan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13427081#comment-13427081 ]
Santhosh Srinivasan commented on PIG-2854:
------------------------------------------
The patch has been committed to trunk. I tested the changes for both Hadoop 20 and Hadoop 23. There are unrelated failure in TestDBStorage (20 and 23) and TestMultiStorage (23)
Thanks Cheolsoo!
> AvroStorage doesn't work with Avro 1.7.1
> ----------------------------------------
>
> Key: PIG-2854
> URL: https://issues.apache.org/jira/browse/PIG-2854
> Project: Pig
> Issue Type: Bug
> Components: piggybank
> Affects Versions: 0.10.0
> Reporter: Cheolsoo Park
> Assignee: Cheolsoo Park
> Attachments: PIG-2854.patch
>
>
> PigAvroDatumWriter fails to compile against Avro 1.7.1 with the following error:
> {code}
> /home/cheolsoo/workspace/pig-trunk/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/PigAvroDatumWriter.java:119: resolveUnion(org.apache.avro.Schema,java.lang.Object) in org.apache.pig.piggybank.storage.avro.PigAvroDatumWriter cannot override resolveUnion(org.apache.avro.Schema,java.lang.Object) in org.apache.avro.generic.GenericDatumWriter; overridden method does not throw java.io.IOException
> protected int resolveUnion(Schema union, Object datum) throws IOException {
> {code}
> The problem is that a new method resolveUnion() is added to GenericDatumWriter in Avro 1.6.x and 1.7.x, but this method conflicts with the one that already exists in PigAvroDatatumWriter.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2854) AvroStorage doesn't work with Avro
1.7.1
Posted by "Cheolsoo Park (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Cheolsoo Park updated PIG-2854:
-------------------------------
Attachment: PIG-2854.patch
Attached is a patch that changes the name of the method in PigAvroDatumWriter from resolveUnion() to resolveUnionSchema() to avoid the conflict.
I tested against Avro 1.5.3, 1.6.3, and 1.7.1.
Thanks!
> AvroStorage doesn't work with Avro 1.7.1
> ----------------------------------------
>
> Key: PIG-2854
> URL: https://issues.apache.org/jira/browse/PIG-2854
> Project: Pig
> Issue Type: Bug
> Components: piggybank
> Affects Versions: 0.10.0
> Reporter: Cheolsoo Park
> Assignee: Cheolsoo Park
> Attachments: PIG-2854.patch
>
>
> PigAvroDatumWriter fails to compile against Avro 1.7.1 with the following error:
> {code}
> /home/cheolsoo/workspace/pig-trunk/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/PigAvroDatumWriter.java:119: resolveUnion(org.apache.avro.Schema,java.lang.Object) in org.apache.pig.piggybank.storage.avro.PigAvroDatumWriter cannot override resolveUnion(org.apache.avro.Schema,java.lang.Object) in org.apache.avro.generic.GenericDatumWriter; overridden method does not throw java.io.IOException
> protected int resolveUnion(Schema union, Object datum) throws IOException {
> {code}
> The problem is that a new method resolveUnion() is added to GenericDatumWriter in Avro 1.6.x and 1.7.x, but this method conflicts with the one that already exists in PigAvroDatatumWriter.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2854) AvroStorage doesn't work with Avro
1.7.1
Posted by "Santhosh Srinivasan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Santhosh Srinivasan updated PIG-2854:
-------------------------------------
Resolution: Fixed
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
> AvroStorage doesn't work with Avro 1.7.1
> ----------------------------------------
>
> Key: PIG-2854
> URL: https://issues.apache.org/jira/browse/PIG-2854
> Project: Pig
> Issue Type: Bug
> Components: piggybank
> Affects Versions: 0.10.0
> Reporter: Cheolsoo Park
> Assignee: Cheolsoo Park
> Attachments: PIG-2854.patch
>
>
> PigAvroDatumWriter fails to compile against Avro 1.7.1 with the following error:
> {code}
> /home/cheolsoo/workspace/pig-trunk/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/PigAvroDatumWriter.java:119: resolveUnion(org.apache.avro.Schema,java.lang.Object) in org.apache.pig.piggybank.storage.avro.PigAvroDatumWriter cannot override resolveUnion(org.apache.avro.Schema,java.lang.Object) in org.apache.avro.generic.GenericDatumWriter; overridden method does not throw java.io.IOException
> protected int resolveUnion(Schema union, Object datum) throws IOException {
> {code}
> The problem is that a new method resolveUnion() is added to GenericDatumWriter in Avro 1.6.x and 1.7.x, but this method conflicts with the one that already exists in PigAvroDatatumWriter.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Work started] (PIG-2854) AvroStorage doesn't work with Avro
1.7.1
Posted by "Cheolsoo Park (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Work on PIG-2854 started by Cheolsoo Park.
> AvroStorage doesn't work with Avro 1.7.1
> ----------------------------------------
>
> Key: PIG-2854
> URL: https://issues.apache.org/jira/browse/PIG-2854
> Project: Pig
> Issue Type: Bug
> Components: piggybank
> Affects Versions: 0.10.0
> Reporter: Cheolsoo Park
> Assignee: Cheolsoo Park
> Attachments: PIG-2854.patch
>
>
> PigAvroDatumWriter fails to compile against Avro 1.7.1 with the following error:
> {code}
> /home/cheolsoo/workspace/pig-trunk/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/PigAvroDatumWriter.java:119: resolveUnion(org.apache.avro.Schema,java.lang.Object) in org.apache.pig.piggybank.storage.avro.PigAvroDatumWriter cannot override resolveUnion(org.apache.avro.Schema,java.lang.Object) in org.apache.avro.generic.GenericDatumWriter; overridden method does not throw java.io.IOException
> protected int resolveUnion(Schema union, Object datum) throws IOException {
> {code}
> The problem is that a new method resolveUnion() is added to GenericDatumWriter in Avro 1.6.x and 1.7.x, but this method conflicts with the one that already exists in PigAvroDatatumWriter.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2854) AvroStorage doesn't work with Avro
1.7.1
Posted by "Cheolsoo Park (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Cheolsoo Park updated PIG-2854:
-------------------------------
Fix Version/s: 0.11
> AvroStorage doesn't work with Avro 1.7.1
> ----------------------------------------
>
> Key: PIG-2854
> URL: https://issues.apache.org/jira/browse/PIG-2854
> Project: Pig
> Issue Type: Bug
> Components: piggybank
> Affects Versions: 0.10.0
> Reporter: Cheolsoo Park
> Assignee: Cheolsoo Park
> Fix For: 0.11
>
> Attachments: PIG-2854.patch
>
>
> PigAvroDatumWriter fails to compile against Avro 1.7.1 with the following error:
> {code}
> /home/cheolsoo/workspace/pig-trunk/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/PigAvroDatumWriter.java:119: resolveUnion(org.apache.avro.Schema,java.lang.Object) in org.apache.pig.piggybank.storage.avro.PigAvroDatumWriter cannot override resolveUnion(org.apache.avro.Schema,java.lang.Object) in org.apache.avro.generic.GenericDatumWriter; overridden method does not throw java.io.IOException
> protected int resolveUnion(Schema union, Object datum) throws IOException {
> {code}
> The problem is that a new method resolveUnion() is added to GenericDatumWriter in Avro 1.6.x and 1.7.x, but this method conflicts with the one that already exists in PigAvroDatatumWriter.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (PIG-2854) AvroStorage doesn't work with Avro
1.7.1
Posted by "Cheolsoo Park (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Cheolsoo Park updated PIG-2854:
-------------------------------
Status: Patch Available (was: In Progress)
> AvroStorage doesn't work with Avro 1.7.1
> ----------------------------------------
>
> Key: PIG-2854
> URL: https://issues.apache.org/jira/browse/PIG-2854
> Project: Pig
> Issue Type: Bug
> Components: piggybank
> Affects Versions: 0.10.0
> Reporter: Cheolsoo Park
> Assignee: Cheolsoo Park
> Attachments: PIG-2854.patch
>
>
> PigAvroDatumWriter fails to compile against Avro 1.7.1 with the following error:
> {code}
> /home/cheolsoo/workspace/pig-trunk/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/PigAvroDatumWriter.java:119: resolveUnion(org.apache.avro.Schema,java.lang.Object) in org.apache.pig.piggybank.storage.avro.PigAvroDatumWriter cannot override resolveUnion(org.apache.avro.Schema,java.lang.Object) in org.apache.avro.generic.GenericDatumWriter; overridden method does not throw java.io.IOException
> protected int resolveUnion(Schema union, Object datum) throws IOException {
> {code}
> The problem is that a new method resolveUnion() is added to GenericDatumWriter in Avro 1.6.x and 1.7.x, but this method conflicts with the one that already exists in PigAvroDatatumWriter.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (PIG-2854) AvroStorage doesn't work with Avro
1.7.1
Posted by "Santhosh Srinivasan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/PIG-2854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13427070#comment-13427070 ]
Santhosh Srinivasan commented on PIG-2854:
------------------------------------------
+1 looks good. I will commit it after running the tests.
> AvroStorage doesn't work with Avro 1.7.1
> ----------------------------------------
>
> Key: PIG-2854
> URL: https://issues.apache.org/jira/browse/PIG-2854
> Project: Pig
> Issue Type: Bug
> Components: piggybank
> Affects Versions: 0.10.0
> Reporter: Cheolsoo Park
> Assignee: Cheolsoo Park
> Attachments: PIG-2854.patch
>
>
> PigAvroDatumWriter fails to compile against Avro 1.7.1 with the following error:
> {code}
> /home/cheolsoo/workspace/pig-trunk/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/storage/avro/PigAvroDatumWriter.java:119: resolveUnion(org.apache.avro.Schema,java.lang.Object) in org.apache.pig.piggybank.storage.avro.PigAvroDatumWriter cannot override resolveUnion(org.apache.avro.Schema,java.lang.Object) in org.apache.avro.generic.GenericDatumWriter; overridden method does not throw java.io.IOException
> protected int resolveUnion(Schema union, Object datum) throws IOException {
> {code}
> The problem is that a new method resolveUnion() is added to GenericDatumWriter in Avro 1.6.x and 1.7.x, but this method conflicts with the one that already exists in PigAvroDatatumWriter.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira