Nutch Crawling for Videos

[Robert Irribarren <ro...@algorithms.io>]

I am wondering how I would make nutch crawl for videos say, youtube. I also
want this to be a seperate section in solr. So when I search I can filter
the results into videos and just websites.

Re: Nutch Crawling for Videos

[Lewis John Mcgibbney <le...@gmail.com>]

Hi Robert,

There is a parse-swf plugin for Nutch which uses the JavaSWF library
[0] to parse such files (of what version I am not currently aware) and
I can confirm that it does work e.g. when used from command line I can
obtain parse data from within a local swf file.
I am not sure if this plugin can extract flash files embedded within
webpages though. It would be great for you to use it and provide us
with a bit of feedback base on your experience.

hth

Lewis

[0] http://www.anotherbigidea.com/javaswf/

On Mon, Aug 20, 2012 at 8:06 AM, Robert Irribarren <ro...@algorithms.io> wrote:
> I am wondering how I would make nutch crawl for videos say, youtube. I also
> want this to be a seperate section in solr. So when I search I can filter
> the results into videos and just websites.



-- 
Lewis