You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@chukwa.apache.org by "Bill Graham (JIRA)" <ji...@apache.org> on 2010/07/16 00:00:57 UTC
[jira] Created: (CHUKWA-495) Implement Pig 0.7.0 compatible Loader
class
Implement Pig 0.7.0 compatible Loader class
-------------------------------------------
Key: CHUKWA-495
URL: https://issues.apache.org/jira/browse/CHUKWA-495
Project: Chukwa
Issue Type: Improvement
Reporter: Bill Graham
Assignee: Bill Graham
Pig 0.7.0 introduces a revamped Load/Store model that is not backward compatible with previous Pig releases. We need to create new classes to handle loading/storing Chukwa data from Pig. Since the new load/store model uses abstract super classes instead of interfaces, I propose we deprecate {{org.apache.hadoop.chukwa.ChukwaStorage}} and create the following classes:
{noformat}
org.apache.hadoop.chukwa.pig.ChukwaLoader
org.apache.hadoop.chukwa.pig.ChukwaStorer
{noformat}
This jira is for the former. Note the addition of the pig sub-package. Thoughts about this approach? Has anyone written code to do this yet?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-495) Implement Pig 0.7.0 compatible
Loader class
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12888969#action_12888969 ]
Eric Yang commented on CHUKWA-495:
----------------------------------
+1 on this refactor.
> Implement Pig 0.7.0 compatible Loader class
> -------------------------------------------
>
> Key: CHUKWA-495
> URL: https://issues.apache.org/jira/browse/CHUKWA-495
> Project: Chukwa
> Issue Type: Improvement
> Reporter: Bill Graham
> Assignee: Bill Graham
>
> Pig 0.7.0 introduces a revamped Load/Store model that is not backward compatible with previous Pig releases. We need to create new classes to handle loading/storing Chukwa data from Pig. Since the new load/store model uses abstract super classes instead of interfaces, I propose we deprecate {{org.apache.hadoop.chukwa.ChukwaStorage}} and create the following classes:
> {noformat}
> org.apache.hadoop.chukwa.pig.ChukwaLoader
> org.apache.hadoop.chukwa.pig.ChukwaStorer
> {noformat}
> This jira is for the former. Note the addition of the pig sub-package. Thoughts about this approach? Has anyone written code to do this yet?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-495) Implement Pig 0.7.0 compatible
Loader and Storer classes
Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12893051#action_12893051 ]
Ari Rabkin commented on CHUKWA-495:
-----------------------------------
No, it looked fine. I was holding off on committing pending more operational experience; I assumed the people who needed it would be trying it. I'll commit it tomorrow barring objection.
> Implement Pig 0.7.0 compatible Loader and Storer classes
> --------------------------------------------------------
>
> Key: CHUKWA-495
> URL: https://issues.apache.org/jira/browse/CHUKWA-495
> Project: Chukwa
> Issue Type: Improvement
> Reporter: Bill Graham
> Assignee: Bill Graham
> Attachments: CHUKWA-495.1.patch, chukwa-pig.jar, pig-0.7.0-test.jar, pig-0.7.0.jar.gz
>
>
> Pig 0.7.0 introduces a revamped Load/Store model that is not backward compatible with previous Pig releases. We need to create new classes to handle loading/storing Chukwa data from Pig. Since the new load/store model uses abstract super classes instead of interfaces, I propose we deprecate {{org.apache.hadoop.chukwa.ChukwaStorage}} and create the following classes:
> {noformat}
> org.apache.hadoop.chukwa.pig.ChukwaLoader
> org.apache.hadoop.chukwa.pig.ChukwaStorer
> {noformat}
> Note the addition of the pig sub-package. Thoughts about this approach?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-495) Implement Pig 0.7.0 compatible
Loader and Storer classes
Posted by "Bill Graham (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12889756#action_12889756 ]
Bill Graham commented on CHUKWA-495:
------------------------------------
I've tested the loader on my cluster and it's working well. I don't have any use cases where the storer is used in my cluster though, so I can't easily test that. The pig unit tests pass though. I still need to update the ChukwaArchiver class as well and then I can submit a patch, hopefully in the next day or two.
> Implement Pig 0.7.0 compatible Loader and Storer classes
> --------------------------------------------------------
>
> Key: CHUKWA-495
> URL: https://issues.apache.org/jira/browse/CHUKWA-495
> Project: Chukwa
> Issue Type: Improvement
> Reporter: Bill Graham
> Assignee: Bill Graham
>
> Pig 0.7.0 introduces a revamped Load/Store model that is not backward compatible with previous Pig releases. We need to create new classes to handle loading/storing Chukwa data from Pig. Since the new load/store model uses abstract super classes instead of interfaces, I propose we deprecate {{org.apache.hadoop.chukwa.ChukwaStorage}} and create the following classes:
> {noformat}
> org.apache.hadoop.chukwa.pig.ChukwaLoader
> org.apache.hadoop.chukwa.pig.ChukwaStorer
> {noformat}
> Note the addition of the pig sub-package. Thoughts about this approach?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-495) Implement Pig 0.7.0 compatible Loader
and Storer classes
Posted by "Bill Graham (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bill Graham updated CHUKWA-495:
-------------------------------
Summary: Implement Pig 0.7.0 compatible Loader and Storer classes (was: Implement Pig 0.7.0 compatible Loader class)
Description:
Pig 0.7.0 introduces a revamped Load/Store model that is not backward compatible with previous Pig releases. We need to create new classes to handle loading/storing Chukwa data from Pig. Since the new load/store model uses abstract super classes instead of interfaces, I propose we deprecate {{org.apache.hadoop.chukwa.ChukwaStorage}} and create the following classes:
{noformat}
org.apache.hadoop.chukwa.pig.ChukwaLoader
org.apache.hadoop.chukwa.pig.ChukwaStorer
{noformat}
Note the addition of the pig sub-package. Thoughts about this approach?
was:
Pig 0.7.0 introduces a revamped Load/Store model that is not backward compatible with previous Pig releases. We need to create new classes to handle loading/storing Chukwa data from Pig. Since the new load/store model uses abstract super classes instead of interfaces, I propose we deprecate {{org.apache.hadoop.chukwa.ChukwaStorage}} and create the following classes:
{noformat}
org.apache.hadoop.chukwa.pig.ChukwaLoader
org.apache.hadoop.chukwa.pig.ChukwaStorer
{noformat}
This jira is for the former. Note the addition of the pig sub-package. Thoughts about this approach? Has anyone written code to do this yet?
Changing title. I've written both the loader and the storer classes.
It will be tricky to deprecate ChukwaStorage, because it will require a different Pig version < 0.7 to compile, but the other classes will require 0.7. Should we remove this class instead?
> Implement Pig 0.7.0 compatible Loader and Storer classes
> --------------------------------------------------------
>
> Key: CHUKWA-495
> URL: https://issues.apache.org/jira/browse/CHUKWA-495
> Project: Chukwa
> Issue Type: Improvement
> Reporter: Bill Graham
> Assignee: Bill Graham
>
> Pig 0.7.0 introduces a revamped Load/Store model that is not backward compatible with previous Pig releases. We need to create new classes to handle loading/storing Chukwa data from Pig. Since the new load/store model uses abstract super classes instead of interfaces, I propose we deprecate {{org.apache.hadoop.chukwa.ChukwaStorage}} and create the following classes:
> {noformat}
> org.apache.hadoop.chukwa.pig.ChukwaLoader
> org.apache.hadoop.chukwa.pig.ChukwaStorer
> {noformat}
> Note the addition of the pig sub-package. Thoughts about this approach?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-495) Implement Pig 0.7.0 compatible Loader
and Storer classes
Posted by "Bill Graham (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bill Graham updated CHUKWA-495:
-------------------------------
Status: Patch Available (was: Open)
> Implement Pig 0.7.0 compatible Loader and Storer classes
> --------------------------------------------------------
>
> Key: CHUKWA-495
> URL: https://issues.apache.org/jira/browse/CHUKWA-495
> Project: Chukwa
> Issue Type: Improvement
> Reporter: Bill Graham
> Assignee: Bill Graham
> Attachments: CHUKWA-495.1.patch, chukwa-pig.jar, pig-0.7.0-test.jar, pig-0.7.0.jar.gz
>
>
> Pig 0.7.0 introduces a revamped Load/Store model that is not backward compatible with previous Pig releases. We need to create new classes to handle loading/storing Chukwa data from Pig. Since the new load/store model uses abstract super classes instead of interfaces, I propose we deprecate {{org.apache.hadoop.chukwa.ChukwaStorage}} and create the following classes:
> {noformat}
> org.apache.hadoop.chukwa.pig.ChukwaLoader
> org.apache.hadoop.chukwa.pig.ChukwaStorer
> {noformat}
> Note the addition of the pig sub-package. Thoughts about this approach?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-495) Implement Pig 0.7.0 compatible Loader
and Storer classes
Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ari Rabkin updated CHUKWA-495:
------------------------------
Status: Resolved (was: Patch Available)
Resolution: Fixed
I just committed this. Thanks, Bill!
> Implement Pig 0.7.0 compatible Loader and Storer classes
> --------------------------------------------------------
>
> Key: CHUKWA-495
> URL: https://issues.apache.org/jira/browse/CHUKWA-495
> Project: Chukwa
> Issue Type: Improvement
> Reporter: Bill Graham
> Assignee: Bill Graham
> Attachments: CHUKWA-495.1.patch, chukwa-pig.jar, pig-0.7.0-test.jar, pig-0.7.0.jar.gz
>
>
> Pig 0.7.0 introduces a revamped Load/Store model that is not backward compatible with previous Pig releases. We need to create new classes to handle loading/storing Chukwa data from Pig. Since the new load/store model uses abstract super classes instead of interfaces, I propose we deprecate {{org.apache.hadoop.chukwa.ChukwaStorage}} and create the following classes:
> {noformat}
> org.apache.hadoop.chukwa.pig.ChukwaLoader
> org.apache.hadoop.chukwa.pig.ChukwaStorer
> {noformat}
> Note the addition of the pig sub-package. Thoughts about this approach?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-495) Implement Pig 0.7.0 compatible
Loader and Storer classes
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12889753#action_12889753 ]
Eric Yang commented on CHUKWA-495:
----------------------------------
It's best to keep current with dependency library. Yes, please remove the stale code as part of your patch. Thanks
> Implement Pig 0.7.0 compatible Loader and Storer classes
> --------------------------------------------------------
>
> Key: CHUKWA-495
> URL: https://issues.apache.org/jira/browse/CHUKWA-495
> Project: Chukwa
> Issue Type: Improvement
> Reporter: Bill Graham
> Assignee: Bill Graham
>
> Pig 0.7.0 introduces a revamped Load/Store model that is not backward compatible with previous Pig releases. We need to create new classes to handle loading/storing Chukwa data from Pig. Since the new load/store model uses abstract super classes instead of interfaces, I propose we deprecate {{org.apache.hadoop.chukwa.ChukwaStorage}} and create the following classes:
> {noformat}
> org.apache.hadoop.chukwa.pig.ChukwaLoader
> org.apache.hadoop.chukwa.pig.ChukwaStorer
> {noformat}
> Note the addition of the pig sub-package. Thoughts about this approach?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-495) Implement Pig 0.7.0 compatible Loader
and Storer classes
Posted by "Bill Graham (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bill Graham updated CHUKWA-495:
-------------------------------
Release Note: Chukwa now requires Pig 0.7.x. ChukwaStorage has been replaced by ChukwaLoader and ChukwaStorer classes.
> Implement Pig 0.7.0 compatible Loader and Storer classes
> --------------------------------------------------------
>
> Key: CHUKWA-495
> URL: https://issues.apache.org/jira/browse/CHUKWA-495
> Project: Chukwa
> Issue Type: Improvement
> Reporter: Bill Graham
> Assignee: Bill Graham
> Attachments: CHUKWA-495.1.patch, chukwa-pig.jar, pig-0.7.0-test.jar, pig-0.7.0.jar.gz
>
>
> Pig 0.7.0 introduces a revamped Load/Store model that is not backward compatible with previous Pig releases. We need to create new classes to handle loading/storing Chukwa data from Pig. Since the new load/store model uses abstract super classes instead of interfaces, I propose we deprecate {{org.apache.hadoop.chukwa.ChukwaStorage}} and create the following classes:
> {noformat}
> org.apache.hadoop.chukwa.pig.ChukwaLoader
> org.apache.hadoop.chukwa.pig.ChukwaStorer
> {noformat}
> Note the addition of the pig sub-package. Thoughts about this approach?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-495) Implement Pig 0.7.0 compatible
Loader and Storer classes
Posted by "Bill Graham (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12893019#action_12893019 ]
Bill Graham commented on CHUKWA-495:
------------------------------------
Ping. Any comments on this patch?
> Implement Pig 0.7.0 compatible Loader and Storer classes
> --------------------------------------------------------
>
> Key: CHUKWA-495
> URL: https://issues.apache.org/jira/browse/CHUKWA-495
> Project: Chukwa
> Issue Type: Improvement
> Reporter: Bill Graham
> Assignee: Bill Graham
> Attachments: CHUKWA-495.1.patch, chukwa-pig.jar, pig-0.7.0-test.jar, pig-0.7.0.jar.gz
>
>
> Pig 0.7.0 introduces a revamped Load/Store model that is not backward compatible with previous Pig releases. We need to create new classes to handle loading/storing Chukwa data from Pig. Since the new load/store model uses abstract super classes instead of interfaces, I propose we deprecate {{org.apache.hadoop.chukwa.ChukwaStorage}} and create the following classes:
> {noformat}
> org.apache.hadoop.chukwa.pig.ChukwaLoader
> org.apache.hadoop.chukwa.pig.ChukwaStorer
> {noformat}
> Note the addition of the pig sub-package. Thoughts about this approach?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
Re: [jira] Commented: (CHUKWA-495) Implement Pig 0.7.0 compatible
Loader and Storer classes
Posted by James Seigel <ja...@tynt.com>.
Looking forward to the loader. Thanks gang!
J
On 2010-07-18, at 10:42 PM, Corbin Hoenes wrote:
> Bill let me know if you need some help testing I out I'm pretty
> stoaked this is coming and would be happy to help.
>
> Sent from my iPhone
>
> On Jul 18, 2010, at 10:22 PM, "Ari Rabkin (JIRA)" <ji...@apache.org>
> wrote:
>
>>
>> [ https://issues.apache.org/jira/browse/CHUKWA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12889754#action_12889754
>> ]
>>
>> Ari Rabkin commented on CHUKWA-495:
>> -----------------------------------
>>
>> Have you tested the new patch on your cluster? Is it committable yet?
>>
>>> Implement Pig 0.7.0 compatible Loader and Storer classes
>>> --------------------------------------------------------
>>>
>>> Key: CHUKWA-495
>>> URL: https://issues.apache.org/jira/browse/CHUKWA-495
>>> Project: Chukwa
>>> Issue Type: Improvement
>>> Reporter: Bill Graham
>>> Assignee: Bill Graham
>>>
>>> Pig 0.7.0 introduces a revamped Load/Store model that is not
>>> backward compatible with previous Pig releases. We need to create
>>> new classes to handle loading/storing Chukwa data from Pig. Since
>>> the new load/store model uses abstract super classes instead of
>>> interfaces, I propose we deprecate
>>> {{org.apache.hadoop.chukwa.ChukwaStorage}} and create the following
>>> classes:
>>> {noformat}
>>> org.apache.hadoop.chukwa.pig.ChukwaLoader
>>> org.apache.hadoop.chukwa.pig.ChukwaStorer
>>> {noformat}
>>> Note the addition of the pig sub-package. Thoughts about this
>>> approach?
>>
>> --
>> This message is automatically generated by JIRA.
>> -
>> You can reply to this email to add a comment to the issue online.
>>
Re: [jira] Commented: (CHUKWA-495) Implement Pig 0.7.0 compatible Loader and Storer classes
Posted by Corbin Hoenes <co...@tynt.com>.
Bill let me know if you need some help testing I out I'm pretty
stoaked this is coming and would be happy to help.
Sent from my iPhone
On Jul 18, 2010, at 10:22 PM, "Ari Rabkin (JIRA)" <ji...@apache.org>
wrote:
>
> [ https://issues.apache.org/jira/browse/CHUKWA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12889754#action_12889754
> ]
>
> Ari Rabkin commented on CHUKWA-495:
> -----------------------------------
>
> Have you tested the new patch on your cluster? Is it committable yet?
>
>> Implement Pig 0.7.0 compatible Loader and Storer classes
>> --------------------------------------------------------
>>
>> Key: CHUKWA-495
>> URL: https://issues.apache.org/jira/browse/CHUKWA-495
>> Project: Chukwa
>> Issue Type: Improvement
>> Reporter: Bill Graham
>> Assignee: Bill Graham
>>
>> Pig 0.7.0 introduces a revamped Load/Store model that is not
>> backward compatible with previous Pig releases. We need to create
>> new classes to handle loading/storing Chukwa data from Pig. Since
>> the new load/store model uses abstract super classes instead of
>> interfaces, I propose we deprecate
>> {{org.apache.hadoop.chukwa.ChukwaStorage}} and create the following
>> classes:
>> {noformat}
>> org.apache.hadoop.chukwa.pig.ChukwaLoader
>> org.apache.hadoop.chukwa.pig.ChukwaStorer
>> {noformat}
>> Note the addition of the pig sub-package. Thoughts about this
>> approach?
>
> --
> This message is automatically generated by JIRA.
> -
> You can reply to this email to add a comment to the issue online.
>
[jira] Commented: (CHUKWA-495) Implement Pig 0.7.0 compatible
Loader and Storer classes
Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12889754#action_12889754 ]
Ari Rabkin commented on CHUKWA-495:
-----------------------------------
Have you tested the new patch on your cluster? Is it committable yet?
> Implement Pig 0.7.0 compatible Loader and Storer classes
> --------------------------------------------------------
>
> Key: CHUKWA-495
> URL: https://issues.apache.org/jira/browse/CHUKWA-495
> Project: Chukwa
> Issue Type: Improvement
> Reporter: Bill Graham
> Assignee: Bill Graham
>
> Pig 0.7.0 introduces a revamped Load/Store model that is not backward compatible with previous Pig releases. We need to create new classes to handle loading/storing Chukwa data from Pig. Since the new load/store model uses abstract super classes instead of interfaces, I propose we deprecate {{org.apache.hadoop.chukwa.ChukwaStorage}} and create the following classes:
> {noformat}
> org.apache.hadoop.chukwa.pig.ChukwaLoader
> org.apache.hadoop.chukwa.pig.ChukwaStorer
> {noformat}
> Note the addition of the pig sub-package. Thoughts about this approach?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-495) Implement Pig 0.7.0 compatible Loader
and Storer classes
Posted by "Bill Graham (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bill Graham updated CHUKWA-495:
-------------------------------
Attachment: pig-0.7.0.jar.gz
Uploading gzipped pig core jar, since it's > 10M.
> Implement Pig 0.7.0 compatible Loader and Storer classes
> --------------------------------------------------------
>
> Key: CHUKWA-495
> URL: https://issues.apache.org/jira/browse/CHUKWA-495
> Project: Chukwa
> Issue Type: Improvement
> Reporter: Bill Graham
> Assignee: Bill Graham
> Attachments: CHUKWA-495.1.patch, chukwa-pig.jar, pig-0.7.0-test.jar, pig-0.7.0.jar.gz
>
>
> Pig 0.7.0 introduces a revamped Load/Store model that is not backward compatible with previous Pig releases. We need to create new classes to handle loading/storing Chukwa data from Pig. Since the new load/store model uses abstract super classes instead of interfaces, I propose we deprecate {{org.apache.hadoop.chukwa.ChukwaStorage}} and create the following classes:
> {noformat}
> org.apache.hadoop.chukwa.pig.ChukwaLoader
> org.apache.hadoop.chukwa.pig.ChukwaStorer
> {noformat}
> Note the addition of the pig sub-package. Thoughts about this approach?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-495) Implement Pig 0.7.0 compatible Loader
and Storer classes
Posted by "Bill Graham (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Bill Graham updated CHUKWA-495:
-------------------------------
Attachment: CHUKWA-495.1.patch
pig-0.7.0-test.jar
chukwa-pig.jar
Attached is CHUKWA-495.1.patch, which includes the new classes mentioned above, along with a refactored {{ChukwaArchive}} class. Please review these changes. Note the change in line 82 of {{TestLocalChukwaStorage}}. Basically, when setting the output path is set to {{chukwa-pig.evt}}, Pig writes out to {{chukwa-pig.evt/part-m-00000}}. I'm not sure how to keep that from happening so we need to make sure that change is ok.
I've also attached pig-0.7.0 jars built from the pig distro at this mirror (pig.jar and pig-test.jar should be removed):
http://mirror.atlanticmetro.net/apache/hadoop/pig/pig-0.7.0/
I wasn't able to find a pig distro in the maven repositories listed in the maven configs. If we find one, we can handle that change in a seperate JIRA.
Finally, I don't know what the purpose of having contrib/chukwa-pig/chukwa-pig.jar in SVN, since it's generated at build time but I haven't removed it. I've uploaded my version too, in the event we need to commit that to what's current.
> Implement Pig 0.7.0 compatible Loader and Storer classes
> --------------------------------------------------------
>
> Key: CHUKWA-495
> URL: https://issues.apache.org/jira/browse/CHUKWA-495
> Project: Chukwa
> Issue Type: Improvement
> Reporter: Bill Graham
> Assignee: Bill Graham
> Attachments: CHUKWA-495.1.patch, chukwa-pig.jar, pig-0.7.0-test.jar, pig-0.7.0.jar.gz
>
>
> Pig 0.7.0 introduces a revamped Load/Store model that is not backward compatible with previous Pig releases. We need to create new classes to handle loading/storing Chukwa data from Pig. Since the new load/store model uses abstract super classes instead of interfaces, I propose we deprecate {{org.apache.hadoop.chukwa.ChukwaStorage}} and create the following classes:
> {noformat}
> org.apache.hadoop.chukwa.pig.ChukwaLoader
> org.apache.hadoop.chukwa.pig.ChukwaStorer
> {noformat}
> Note the addition of the pig sub-package. Thoughts about this approach?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.