You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@pig.apache.org by Stan Rosenberg <sr...@proclivitysystems.com> on 2012/01/24 23:10:21 UTC
DBLoader
Hi,
Quick question: is anyone aware of a DBLoad UDF, preferably based on
hadoop's DBInputFormat? I am aware that there are other better
solutions, e.g., sqoop.
I can see DBStorage in piggybank, but not DBLoad.
Thanks,
stan
Re: DBLoader
Posted by Ashutosh Chauhan <as...@gmail.com>.
My bad; You are correct, its only for store not for load. I don't know of
any readymade DBStorer for Pig. Looks like you will need to write one.
Ashutosh
On Tue, Jan 24, 2012 at 14:23, Stan Rosenberg <
srosenberg@proclivitysystems.com> wrote:
> Actually, I don't see the loading capability. Unless I am looking at
> the wrong code, org.apache.pig.piggybank.storage.DBStorage extends
> StoreFunc; it does not implement 'getNext'.
>
> stan
>
>
> On Tue, Jan 24, 2012 at 5:17 PM, Stan Rosenberg
> <sr...@proclivitysystems.com> wrote:
> > My bad; I should have looked at the code. Thanks Ashutosh!
> >
> > stan
> >
> > On Tue, Jan 24, 2012 at 5:14 PM, Ashutosh Chauhan <ha...@apache.org>
> wrote:
> >> DBStorage can be used for both load and store.
> >>
> >> Hope it helps,
> >> Ashutosh
> >>
> >> On Tue, Jan 24, 2012 at 14:10, Stan Rosenberg <
> >> srosenberg@proclivitysystems.com> wrote:
> >>
> >>> Hi,
> >>>
> >>> Quick question: is anyone aware of a DBLoad UDF, preferably based on
> >>> hadoop's DBInputFormat? I am aware that there are other better
> >>> solutions, e.g., sqoop.
> >>> I can see DBStorage in piggybank, but not DBLoad.
> >>>
> >>> Thanks,
> >>>
> >>> stan
> >>>
>
Re: DBLoader
Posted by Stan Rosenberg <sr...@proclivitysystems.com>.
Actually, I don't see the loading capability. Unless I am looking at
the wrong code, org.apache.pig.piggybank.storage.DBStorage extends
StoreFunc; it does not implement 'getNext'.
stan
On Tue, Jan 24, 2012 at 5:17 PM, Stan Rosenberg
<sr...@proclivitysystems.com> wrote:
> My bad; I should have looked at the code. Thanks Ashutosh!
>
> stan
>
> On Tue, Jan 24, 2012 at 5:14 PM, Ashutosh Chauhan <ha...@apache.org> wrote:
>> DBStorage can be used for both load and store.
>>
>> Hope it helps,
>> Ashutosh
>>
>> On Tue, Jan 24, 2012 at 14:10, Stan Rosenberg <
>> srosenberg@proclivitysystems.com> wrote:
>>
>>> Hi,
>>>
>>> Quick question: is anyone aware of a DBLoad UDF, preferably based on
>>> hadoop's DBInputFormat? I am aware that there are other better
>>> solutions, e.g., sqoop.
>>> I can see DBStorage in piggybank, but not DBLoad.
>>>
>>> Thanks,
>>>
>>> stan
>>>
Re: DBLoader
Posted by Stan Rosenberg <sr...@proclivitysystems.com>.
My bad; I should have looked at the code. Thanks Ashutosh!
stan
On Tue, Jan 24, 2012 at 5:14 PM, Ashutosh Chauhan <ha...@apache.org> wrote:
> DBStorage can be used for both load and store.
>
> Hope it helps,
> Ashutosh
>
> On Tue, Jan 24, 2012 at 14:10, Stan Rosenberg <
> srosenberg@proclivitysystems.com> wrote:
>
>> Hi,
>>
>> Quick question: is anyone aware of a DBLoad UDF, preferably based on
>> hadoop's DBInputFormat? I am aware that there are other better
>> solutions, e.g., sqoop.
>> I can see DBStorage in piggybank, but not DBLoad.
>>
>> Thanks,
>>
>> stan
>>
Re: DBLoader
Posted by Ashutosh Chauhan <ha...@apache.org>.
DBStorage can be used for both load and store.
Hope it helps,
Ashutosh
On Tue, Jan 24, 2012 at 14:10, Stan Rosenberg <
srosenberg@proclivitysystems.com> wrote:
> Hi,
>
> Quick question: is anyone aware of a DBLoad UDF, preferably based on
> hadoop's DBInputFormat? I am aware that there are other better
> solutions, e.g., sqoop.
> I can see DBStorage in piggybank, but not DBLoad.
>
> Thanks,
>
> stan
>