Save_streaming_content_of_website

[Sahil Sharma <sh...@gmail.com>]

Hi everyone,

I want to save all the streaming content of some website, which is
constantly updated with new messages to my storage. Is it possible with
Nutch?
The website and content for example can be:
http://stocktwits.com/symbol/AAPL.

For example,here, users constantly posts their views about AAPL stocks and
I want to extract all these short messages along with their time-stamp
and store in my server.

How can I do so?

Thanks in advance.



-- 
$25: for you a pizza and some beers with friends, for someone might change
their lives. Think about it.

Re: Save_streaming_content_of_website

[Lewis John Mcgibbney <le...@gmail.com>]

Hi Sahil,
This becomes tricky if the site (or more appropriately the server) does not
belong to you. Nutch respects http requests and hammering a server for
dynamic feeds like the ones present on this site is not good practice.
That being said, in the past the advice I have been given is pretty clear
here
  http://www.mail-archive.com/user@nutch.apache.org/msg05081.html
Hth
Lewis

On Monday, January 14, 2013, Sahil Sharma <sh...@gmail.com> wrote:
> Hi everyone,
>
> I want to save all the streaming content of some website, which is
> constantly updated with new messages to my storage. Is it possible with
> Nutch?
> The website and content for example can be:
> http://stocktwits.com/symbol/AAPL.
>
> For example,here, users constantly posts their views about AAPL stocks and
> I want to extract all these short messages along with their time-stamp
> and store in my server.
>
> How can I do so?
>
> Thanks in advance.
>
>
>
> --
> $25: for you a pizza and some beers with friends, for someone might change
> their lives. Think about it.
>

-- 
*Lewis*