You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by visayafan <vi...@163.com> on 2014/12/18 17:06:01 UTC
Which version of Nutch and HBase should I use to match Hadoop 2.4
I have been wasting a lot time on this, Can someone professional help me out?
Can I build Nutch 2.x (2.x branch from Nutch github repo) to make it work with the latest HBase on Hadoop 2.4?
I have wasted a lot time on this and I would be very appreciated if someone can help me.
Thank you for your time.
Re: Which version of Nutch and HBase should I use to match Hadoop 2.4
Posted by Talat Uyarer <ta...@uyarer.com>.
Gora can work with Hbase 0.94 that run top of hadoop 1 or hadoop 2.
BTW if you apply patch of GORA-375, it can work with Hbase 0.98 too.
For example you can use Nutch in local mode and can write hbase that
works on hadoop2. However this does not mean Nutch works on Hadoop2.
Because Nutch use Gora as a mapreduce frameworks. Nutch does not use
hadoop classses for map reduce. Gora has Hadoop 2 support in 0.5 [1]
They tired to make a abstract layer for working with hadoop 1 and
hadoop 2. When I update hadoop dependecies of Nutch. I try to run top
of Hadoop 2.5 But it throws exceptions. Now I try to fix them.
Hope that helps
Talat
[1] http://apache.org/dist/gora/0.5/CHANGES.txt
2014-12-19 8:02 GMT+02:00 visayafan <vi...@163.com>:
> Talat, thank you for your reply.
>
> I find this link https://github.com/dobromyslov/hbase/releases/tag/0.94.18-hadoop-2.4.0 which says
> Nutch 2.x using Gora v0.4 works with HBase 0.94.18 tag with Apache Hadoop 2.4.0, I’m not sure if it
> is ok like the author said. Do you think it’s possible?
> Maybe I should give it a try, I will post the result later.
>
> On 19 Dec, 2014, at 1:25 pm, Talat Uyarer <ta...@uyarer.com> wrote:
>
>> Hi,
>>
>> I am working on Hadoop 2 support of Nutch 2.x Now Gora have some problems
>> working with Hadoop 2. If I fix it, I will submit my Nutch patch.
>>
>> I am planning to finish my works before new year.
>>
>> Talat
>> On Dec 19, 2014 7:10 AM, "visayafan" <vi...@163.com> wrote:
>>
>>> I have been wasting a lot time on this, Can someone professional help me
>>> out?
>>>
>>> Can I build Nutch 2.x (2.x branch from Nutch github repo) to make it work
>>> with the latest HBase on Hadoop 2.4?
>>>
>>> I have wasted a lot time on this and I would be very appreciated if
>>> someone can help me.
>>> Thank you for your time.
>>>
>
--
Talat UYARER
Websitesi: http://talat.uyarer.com
Twitter: http://twitter.com/talatuyarer
Linkedin: http://tr.linkedin.com/pub/talat-uyarer/10/142/304
Re: Which version of Nutch and HBase should I use to match Hadoop 2.4
Posted by visayafan <vi...@163.com>.
Talat, thank you for your reply.
I find this link https://github.com/dobromyslov/hbase/releases/tag/0.94.18-hadoop-2.4.0 which says
Nutch 2.x using Gora v0.4 works with HBase 0.94.18 tag with Apache Hadoop 2.4.0, I’m not sure if it
is ok like the author said. Do you think it’s possible?
Maybe I should give it a try, I will post the result later.
On 19 Dec, 2014, at 1:25 pm, Talat Uyarer <ta...@uyarer.com> wrote:
> Hi,
>
> I am working on Hadoop 2 support of Nutch 2.x Now Gora have some problems
> working with Hadoop 2. If I fix it, I will submit my Nutch patch.
>
> I am planning to finish my works before new year.
>
> Talat
> On Dec 19, 2014 7:10 AM, "visayafan" <vi...@163.com> wrote:
>
>> I have been wasting a lot time on this, Can someone professional help me
>> out?
>>
>> Can I build Nutch 2.x (2.x branch from Nutch github repo) to make it work
>> with the latest HBase on Hadoop 2.4?
>>
>> I have wasted a lot time on this and I would be very appreciated if
>> someone can help me.
>> Thank you for your time.
>>
Re: Which version of Nutch and HBase should I use to match Hadoop 2.4
Posted by Talat Uyarer <ta...@uyarer.com>.
Hi,
I am working on Hadoop 2 support of Nutch 2.x Now Gora have some problems
working with Hadoop 2. If I fix it, I will submit my Nutch patch.
I am planning to finish my works before new year.
Talat
On Dec 19, 2014 7:10 AM, "visayafan" <vi...@163.com> wrote:
> I have been wasting a lot time on this, Can someone professional help me
> out?
>
> Can I build Nutch 2.x (2.x branch from Nutch github repo) to make it work
> with the latest HBase on Hadoop 2.4?
>
> I have wasted a lot time on this and I would be very appreciated if
> someone can help me.
> Thank you for your time.
>