You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@nutch.apache.org by "David Michael Gang (JIRA)" <ji...@apache.org> on 2013/01/15 08:58:14 UTC

[jira] [Created] (NUTCH-1518) session cookies support

David Michael Gang created NUTCH-1518:
-----------------------------------------

             Summary: session cookies support
                 Key: NUTCH-1518
                 URL: https://issues.apache.org/jira/browse/NUTCH-1518
             Project: Nutch
          Issue Type: New Feature
          Components: fetcher
    Affects Versions: 2.1
            Reporter: David Michael Gang


There are internet sites, which in order to get crawled have to store cookies.
For example for a fake internet site
www.blala.com in order to fetch we have to send first
www.blala.com?username=x&password=y
and then the browser stores a sesssion cookie.
Afterwards i can fetch all pages of the domain www.blala.com/a/b/c.html
I want a feature where we define in a file domains of urls and the url how to make logins.
When nutch will see such a site and fetch the page it will login before.
The jira https://issues.apache.org/jira/browse/NUTCH-827
is very similar to what i need.



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira