You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by شجاع الرحمن بیگ <sh...@gmail.com> on 2013/07/26 21:11:34 UTC
Joining N DataSets????
Hi
I am working on a problem where I need to join multiple datasets. The
problem is explained below.
Given N number of datasets, having M relations in between them, i want to
merge them into one dataset where relations could be 1-many or 1-1 and for
connectivity, it is essential that we have atleast N-1 relations so M >=
N-1
Kindly let me know how to solve this issue using Map Reduce
Thanks in advance
--
Regards
Shuja-ur-Rehman Baig
<http://pk.linkedin.com/in/shujamughal>
Re: Joining N DataSets????
Posted by Tim <ti...@gmail.com>.
Hive runs as MR jobs. You could craft your own code in (e.g.) Java, but given the limited info to work with, I'd still say it sounds like a Hive problem. Cascalog and Pig might be worth looking at as well.
Hope this helps, but if not, can you please elaborate on what you're trying to do and it might be easier to advise?
Cheers,
Tim,
Sent from my iPhone (which makes terrible auto-correct spelling mistakes)
On 26 Jul 2013, at 21:50, شجاع الرحمن بیگ <sh...@gmail.com> wrote:
> well...i want solution in map reduce. is there any?
>
>
> On Sat, Jul 27, 2013 at 12:32 AM, Tim Robertson <ti...@gmail.com> wrote:
>> Sounds like you might be interested in Hive.
>>
>>
>>
>> On Fri, Jul 26, 2013 at 9:11 PM, شجاع الرحمن بیگ <sh...@gmail.com> wrote:
>>> Hi
>>> I am working on a problem where I need to join multiple datasets. The problem is explained below.
>>>
>>> Given N number of datasets, having M relations in between them, i want to merge them into one dataset where relations could be 1-many or 1-1 and for connectivity, it is essential that we have atleast N-1 relations so M >= N-1
>>>
>>>
>>> Kindly let me know how to solve this issue using Map Reduce
>>>
>>> Thanks in advance
>>>
>>> --
>>> Regards
>>> Shuja-ur-Rehman Baig
>
>
>
> --
> Regards
> Shuja-ur-Rehman Baig
>
Re: Joining N DataSets????
Posted by شجاع الرحمن بیگ <sh...@gmail.com>.
well...i want solution in map reduce. is there any?
On Sat, Jul 27, 2013 at 12:32 AM, Tim Robertson
<ti...@gmail.com>wrote:
> Sounds like you might be interested in Hive.
>
>
>
> On Fri, Jul 26, 2013 at 9:11 PM, شجاع الرحمن بیگ <sh...@gmail.com>wrote:
>
>> Hi
>> I am working on a problem where I need to join multiple datasets. The
>> problem is explained below.
>>
>> Given N number of datasets, having M relations in between them, i want
>> to merge them into one dataset where relations could be 1-many or 1-1 and
>> for connectivity, it is essential that we have atleast N-1 relations so M
>> >= N-1
>>
>>
>> Kindly let me know how to solve this issue using Map Reduce
>>
>> Thanks in advance
>>
>> --
>> Regards
>> Shuja-ur-Rehman Baig
>> <http://pk.linkedin.com/in/shujamughal>
>>
>
>
--
Regards
Shuja-ur-Rehman Baig
<http://pk.linkedin.com/in/shujamughal>
Re: Joining N DataSets????
Posted by Tim Robertson <ti...@gmail.com>.
Sounds like you might be interested in Hive.
On Fri, Jul 26, 2013 at 9:11 PM, شجاع الرحمن بیگ <sh...@gmail.com>wrote:
> Hi
> I am working on a problem where I need to join multiple datasets. The
> problem is explained below.
>
> Given N number of datasets, having M relations in between them, i want
> to merge them into one dataset where relations could be 1-many or 1-1 and
> for connectivity, it is essential that we have atleast N-1 relations so M
> >= N-1
>
>
> Kindly let me know how to solve this issue using Map Reduce
>
> Thanks in advance
>
> --
> Regards
> Shuja-ur-Rehman Baig
> <http://pk.linkedin.com/in/shujamughal>
>