You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@nutch.apache.org by xingjian <xi...@gmail.com> on 2007/11/12 03:55:31 UTC
How to writes the results of successful fetcher to database.
hi,ervery
How to writes the results of successful fetcher to database。
thanks
--
View this message in context: http://www.nabble.com/How-to-writes-the-results-of-successful-fetcher-to-database.-tf4788594.html#a13699014
Sent from the Nutch - User mailing list archive at Nabble.com.
Re: How to writes the results of successful fetcher to database.
Posted by xingjian <xi...@gmail.com>.
Before Nutch generates Segments, it wants to draw Web page first in fact. But
I as long as gain information content and URL of Web page. Web page
information content is saved to the MySQL/Oracle database, I self carries
out an index by lucene.
I extend Processor in Heritrix,but Nutch i do not know how to do?
xingjian wrote:
>
> hi,ervery
>
> How to get the content of successful fetcher,in order to will this
> content write Oracle database?
> I do not need the function of Nutch indexing.
>
> thanks
>
--
View this message in context: http://www.nabble.com/How-to-writes-the-results-of-successful-fetcher-to-database.-tf4788594.html#a13717899
Sent from the Nutch - User mailing list archive at Nabble.com.
Re: How to writes the results of successful fetcher to database.
Posted by Dennis Kubes <ku...@apache.org>.
In that case you would need to write a custom MapReduce job to read from
the segments format (FetcherOutputFormat I believe) and write out to
the database, an output format implementation.
Dennis Kubes
xingjian wrote:
> i do not save the results of successful fetcher to files on disk.i want to
> save the results to the oracle database.
>
>
> Dennis Kubes-2 wrote:
>> updatedb command
>>
>> xingjian wrote:
>>> hi,ervery
>>> How to writes the results of successful fetcher to database。
>>> thanks
>>
>
Re: How to writes the results of successful fetcher to database.
Posted by xingjian <xi...@gmail.com>.
i do not save the results of successful fetcher to files on disk.i want to
save the results to the oracle database.
Dennis Kubes-2 wrote:
>
> updatedb command
>
> xingjian wrote:
>> hi,ervery
>> How to writes the results of successful fetcher to database。
>> thanks
>
>
--
View this message in context: http://www.nabble.com/How-to-writes-the-results-of-successful-fetcher-to-database.-tf4788594.html#a13699242
Sent from the Nutch - User mailing list archive at Nabble.com.
Re: How to writes the results of successful fetcher to database.
Posted by Dennis Kubes <ku...@apache.org>.
updatedb command
xingjian wrote:
> hi,ervery
> How to writes the results of successful fetcher to database。
> thanks