You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by cesar romero <ce...@romero.ws> on 2012/08/04 20:26:53 UTC

dynamodb for pig

I'm interesting in being able to load and store into DynamoDB tables.
I couldn't find a related JIRA issue[1], and I'm willing to work on it
myself. Is there an issue I missed or can I just create a JIRA issue
myself and start tracking this? Any pointers would be greatly
appreciated as I have not contributed to an apache project in the
past.

Cesar

[1] https://issues.apache.org/jira/secure/IssueNavigator.jspa?reset=true&jqlQuery=summary+~+dynamodb+OR+description+~+dynamodb+OR+comment+~+dynamodb

Re: dynamodb for pig

Posted by Bill Graham <bi...@gmail.com>.
The best places for code like this is github IMO. That allows the code to
be developed and released independently of Pig or DynamoDBs release cycle.



On Mon, Aug 6, 2012 at 10:47 AM, Renato Marroquín Mogrovejo <
renatoj.marroquin@gmail.com> wrote:

> Hi,
>
> These integration classes, do they go into the contribs? or where do
> they fit in Pig's project?
> Cesar, if you need any help on doing this, please just let me know. I
> am in the middle of finishing Gora's integration with Amazon DynamoDB,
> and we have plans to integrate Gora with Pig downstream as well (:
>
>
> Renato M.
>
> 2012/8/6 Bill Graham <bi...@gmail.com>:
> > Hi Cesar,
> >
> > I'm not aware of any DynamoDB integration, but it looks like AWS has it
> on
> > their radar:
> > https://forums.aws.amazon.com/thread.jspa?messageID=337502
> >
> > If you implement something yourself, I recommend looking at the
> > HBaseStorage class in Pig to see an example of how to integrate with an
> > external DB.
> >
> > thanks,
> > Bill
> >
> > On Sat, Aug 4, 2012 at 11:26 AM, cesar romero <ce...@romero.ws> wrote:
> >
> >> I'm interesting in being able to load and store into DynamoDB tables.
> >> I couldn't find a related JIRA issue[1], and I'm willing to work on it
> >> myself. Is there an issue I missed or can I just create a JIRA issue
> >> myself and start tracking this? Any pointers would be greatly
> >> appreciated as I have not contributed to an apache project in the
> >> past.
> >>
> >> Cesar
> >>
> >> [1]
> >>
> https://issues.apache.org/jira/secure/IssueNavigator.jspa?reset=true&jqlQuery=summary+~+dynamodb+OR+description+~+dynamodb+OR+comment+~+dynamodb
> >>
> >
> >
> >
> > --
> > *Note that I'm no longer using my Yahoo! email address. Please email me
> at
> > billgraham@gmail.com going forward.*
>



-- 
*Note that I'm no longer using my Yahoo! email address. Please email me at
billgraham@gmail.com going forward.*

Re: dynamodb for pig

Posted by Renato Marroquín Mogrovejo <re...@gmail.com>.
Hi,

These integration classes, do they go into the contribs? or where do
they fit in Pig's project?
Cesar, if you need any help on doing this, please just let me know. I
am in the middle of finishing Gora's integration with Amazon DynamoDB,
and we have plans to integrate Gora with Pig downstream as well (:


Renato M.

2012/8/6 Bill Graham <bi...@gmail.com>:
> Hi Cesar,
>
> I'm not aware of any DynamoDB integration, but it looks like AWS has it on
> their radar:
> https://forums.aws.amazon.com/thread.jspa?messageID=337502
>
> If you implement something yourself, I recommend looking at the
> HBaseStorage class in Pig to see an example of how to integrate with an
> external DB.
>
> thanks,
> Bill
>
> On Sat, Aug 4, 2012 at 11:26 AM, cesar romero <ce...@romero.ws> wrote:
>
>> I'm interesting in being able to load and store into DynamoDB tables.
>> I couldn't find a related JIRA issue[1], and I'm willing to work on it
>> myself. Is there an issue I missed or can I just create a JIRA issue
>> myself and start tracking this? Any pointers would be greatly
>> appreciated as I have not contributed to an apache project in the
>> past.
>>
>> Cesar
>>
>> [1]
>> https://issues.apache.org/jira/secure/IssueNavigator.jspa?reset=true&jqlQuery=summary+~+dynamodb+OR+description+~+dynamodb+OR+comment+~+dynamodb
>>
>
>
>
> --
> *Note that I'm no longer using my Yahoo! email address. Please email me at
> billgraham@gmail.com going forward.*

Re: dynamodb for pig

Posted by Bill Graham <bi...@gmail.com>.
Hi Cesar,

I'm not aware of any DynamoDB integration, but it looks like AWS has it on
their radar:
https://forums.aws.amazon.com/thread.jspa?messageID=337502

If you implement something yourself, I recommend looking at the
HBaseStorage class in Pig to see an example of how to integrate with an
external DB.

thanks,
Bill

On Sat, Aug 4, 2012 at 11:26 AM, cesar romero <ce...@romero.ws> wrote:

> I'm interesting in being able to load and store into DynamoDB tables.
> I couldn't find a related JIRA issue[1], and I'm willing to work on it
> myself. Is there an issue I missed or can I just create a JIRA issue
> myself and start tracking this? Any pointers would be greatly
> appreciated as I have not contributed to an apache project in the
> past.
>
> Cesar
>
> [1]
> https://issues.apache.org/jira/secure/IssueNavigator.jspa?reset=true&jqlQuery=summary+~+dynamodb+OR+description+~+dynamodb+OR+comment+~+dynamodb
>



-- 
*Note that I'm no longer using my Yahoo! email address. Please email me at
billgraham@gmail.com going forward.*