You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@oodt.apache.org by "Brian Foster (Created) (JIRA)" <ji...@apache.org> on 2011/11/19 21:22:52 UTC
[jira] [Created] (OODT-352) Integrate CAS-CLI into CAS-Crawler
Integrate CAS-CLI into CAS-Crawler
----------------------------------
Key: OODT-352
URL: https://issues.apache.org/jira/browse/OODT-352
Project: OODT
Issue Type: Improvement
Components: crawler
Affects Versions: 0.3
Environment: none
Reporter: Brian Foster
Assignee: Brian Foster
Priority: Minor
Fix For: 0.4
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OODT-352) Integrate CAS-CLI into CAS-Crawler
Posted by "Brian Foster (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OODT-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13171157#comment-13171157 ]
Brian Foster commented on OODT-352:
-----------------------------------
You'll just have to change these 2 lines in your crawler_launcher script:
It will be this:
-Dorg.apache.oodt.cas.cli.action.spring.config=../policy/cmd-line-actions.xml \
-Dorg.apache.oodt.cas.cli.option.spring.config=../policy/cmd-line-options.xml \
You'll change it to something like this:
-Dorg.apache.oodt.cas.cli.action.spring.config=../policy/fuddy-duddy/cmd-line-actions.xml \
-Dorg.apache.oodt.cas.cli.option.spring.config=../policy/fuddy-duddy/cmd-line-options.xml \
is that what you had in mind?
> Integrate CAS-CLI into CAS-Crawler
> ----------------------------------
>
> Key: OODT-352
> URL: https://issues.apache.org/jira/browse/OODT-352
> Project: OODT
> Issue Type: Improvement
> Components: crawler
> Affects Versions: 0.3
> Environment: none
> Reporter: Brian Foster
> Assignee: Brian Foster
> Priority: Minor
> Fix For: 0.4
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OODT-352) Integrate CAS-CLI into CAS-Crawler
Posted by "Paul Ramirez (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OODT-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170579#comment-13170579 ]
Paul Ramirez commented on OODT-352:
-----------------------------------
Was there a reason the command line wouldn't remain the same (i.e. using crawler id)?
> Integrate CAS-CLI into CAS-Crawler
> ----------------------------------
>
> Key: OODT-352
> URL: https://issues.apache.org/jira/browse/OODT-352
> Project: OODT
> Issue Type: Improvement
> Components: crawler
> Affects Versions: 0.3
> Environment: none
> Reporter: Brian Foster
> Assignee: Brian Foster
> Priority: Minor
> Fix For: 0.4
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (OODT-352) Integrate CAS-CLI into CAS-Crawler
Posted by "Brian Foster (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OODT-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brian Foster updated OODT-352:
------------------------------
Attachment: OODT-352.2012-02-10.patch.txt
- cleaned up code a bit
> Integrate CAS-CLI into CAS-Crawler
> ----------------------------------
>
> Key: OODT-352
> URL: https://issues.apache.org/jira/browse/OODT-352
> Project: OODT
> Issue Type: Improvement
> Components: crawler
> Affects Versions: 0.3
> Environment: none
> Reporter: Brian Foster
> Assignee: Brian Foster
> Priority: Minor
> Fix For: 0.4
>
> Attachments: OODT-352.2012-02-10.patch.txt, OODT-352.2012-02-10.patch.txt
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OODT-352) Integrate CAS-CLI into CAS-Crawler
Posted by "Brian Foster (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OODT-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13171265#comment-13171265 ]
Brian Foster commented on OODT-352:
-----------------------------------
you got it!
> Integrate CAS-CLI into CAS-Crawler
> ----------------------------------
>
> Key: OODT-352
> URL: https://issues.apache.org/jira/browse/OODT-352
> Project: OODT
> Issue Type: Improvement
> Components: crawler
> Affects Versions: 0.3
> Environment: none
> Reporter: Brian Foster
> Assignee: Brian Foster
> Priority: Minor
> Fix For: 0.4
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (OODT-352) Integrate CAS-CLI into CAS-Crawler
Posted by "Brian Foster (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OODT-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brian Foster updated OODT-352:
------------------------------
Attachment: OODT-352.2012-02-25.patch.txt
- Updates to support --operation look-and-feel and legacy mode (just point your crawler_launcher option and action java properties at the legacy-*xml files and you've got the same command line as before... updated review board as well
> Integrate CAS-CLI into CAS-Crawler
> ----------------------------------
>
> Key: OODT-352
> URL: https://issues.apache.org/jira/browse/OODT-352
> Project: OODT
> Issue Type: Improvement
> Components: crawler
> Affects Versions: 0.3
> Environment: none
> Reporter: Brian Foster
> Assignee: Brian Foster
> Priority: Minor
> Fix For: 0.4
>
> Attachments: OODT-352.2012-02-10.patch.txt, OODT-352.2012-02-10.patch.txt, OODT-352.2012-02-25.patch.txt
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OODT-352) Integrate CAS-CLI into CAS-Crawler
Posted by "Brian Foster (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OODT-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170502#comment-13170502 ]
Brian Foster commented on OODT-352:
-----------------------------------
okay this is what i've got in mind for this:
./crawler --operation --metExtractorProductCrawler --productPath /staging/area --metFileExtension met --actionNames Unique DeleteDataFile ...etc...
or short version:
./crawler -op -mepc -pp /staging/area -mfe met -ans Unique DeleteDataFile ...etc...
Basically instead of specifying a crawler ID, your crawler would be an operation... let me know what you guys think
> Integrate CAS-CLI into CAS-Crawler
> ----------------------------------
>
> Key: OODT-352
> URL: https://issues.apache.org/jira/browse/OODT-352
> Project: OODT
> Issue Type: Improvement
> Components: crawler
> Affects Versions: 0.3
> Environment: none
> Reporter: Brian Foster
> Assignee: Brian Foster
> Priority: Minor
> Fix For: 0.4
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (OODT-352) Integrate CAS-CLI into
CAS-Crawler
Posted by "Brian Foster (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OODT-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216571#comment-13216571 ]
Brian Foster edited comment on OODT-352 at 2/25/12 11:02 PM:
-------------------------------------------------------------
- Updates to support \-\-operation look-and-feel and legacy mode (just point your crawler_launcher option and action java properties at the legacy-*xml files and you've got the same command line as before... updated review board as well
was (Author: bfoster):
- Updates to support --operation look-and-feel and legacy mode (just point your crawler_launcher option and action java properties at the legacy-*xml files and you've got the same command line as before... updated review board as well
> Integrate CAS-CLI into CAS-Crawler
> ----------------------------------
>
> Key: OODT-352
> URL: https://issues.apache.org/jira/browse/OODT-352
> Project: OODT
> Issue Type: Improvement
> Components: crawler
> Affects Versions: 0.3
> Environment: none
> Reporter: Brian Foster
> Assignee: Brian Foster
> Priority: Minor
> Fix For: 0.4
>
> Attachments: OODT-352.2012-02-10.patch.txt, OODT-352.2012-02-10.patch.txt, OODT-352.2012-02-25.patch.txt
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (OODT-352) Integrate CAS-CLI into CAS-Crawler
Posted by "Brian Foster (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OODT-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brian Foster updated OODT-352:
------------------------------
Attachment: OODT-352.2012-02-10.patch.txt
Okay... only took me like 10 years, but i finally have a rough cut at the fuddy-duddy version of the cas-crawler with cas-cli... got stumped for a while, but ended up find Spring's PropertyOverrideConfigurer which is pretty bad ass and work like a charm!!!
- attached patch
- patch can also be reviewed here: https://reviews.apache.org/r/3854/
> Integrate CAS-CLI into CAS-Crawler
> ----------------------------------
>
> Key: OODT-352
> URL: https://issues.apache.org/jira/browse/OODT-352
> Project: OODT
> Issue Type: Improvement
> Components: crawler
> Affects Versions: 0.3
> Environment: none
> Reporter: Brian Foster
> Assignee: Brian Foster
> Priority: Minor
> Fix For: 0.4
>
> Attachments: OODT-352.2012-02-10.patch.txt
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OODT-352) Integrate CAS-CLI into CAS-Crawler
Posted by "Chris A. Mattmann (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OODT-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13171148#comment-13171148 ]
Chris A. Mattmann commented on OODT-352:
----------------------------------------
Thanks Brian. +1 to checking in the fuddy duddy Spring XMLs as a baked in set, alongside of the new --operation ones. Can we make it simple for a fuddy duddy like me though in terms of my existing ./crawler_launcher wrapper scripts to make it work the same way as before? How should we do that? Maybe an environment variable to switch the configs? Thoughts?
> Integrate CAS-CLI into CAS-Crawler
> ----------------------------------
>
> Key: OODT-352
> URL: https://issues.apache.org/jira/browse/OODT-352
> Project: OODT
> Issue Type: Improvement
> Components: crawler
> Affects Versions: 0.3
> Environment: none
> Reporter: Brian Foster
> Assignee: Brian Foster
> Priority: Minor
> Fix For: 0.4
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (OODT-352) Integrate CAS-CLI into CAS-Crawler
Posted by "Brian Foster (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OODT-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brian Foster resolved OODT-352.
-------------------------------
Resolution: Fixed
- fixed in r1294389
> Integrate CAS-CLI into CAS-Crawler
> ----------------------------------
>
> Key: OODT-352
> URL: https://issues.apache.org/jira/browse/OODT-352
> Project: OODT
> Issue Type: Improvement
> Components: crawler
> Affects Versions: 0.3
> Environment: none
> Reporter: Brian Foster
> Assignee: Brian Foster
> Priority: Minor
> Fix For: 0.4
>
> Attachments: OODT-352.2012-02-10.patch.txt, OODT-352.2012-02-10.patch.txt, OODT-352.2012-02-25.patch.txt
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OODT-352) Integrate CAS-CLI into CAS-Crawler
Posted by "Chris A. Mattmann (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OODT-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13171204#comment-13171204 ]
Chris A. Mattmann commented on OODT-352:
----------------------------------------
Sweet that works for me. Can you update crawler_launcher when you put the patch in to have my fuddy_duddy policy set in there, but commented out?
> Integrate CAS-CLI into CAS-Crawler
> ----------------------------------
>
> Key: OODT-352
> URL: https://issues.apache.org/jira/browse/OODT-352
> Project: OODT
> Issue Type: Improvement
> Components: crawler
> Affects Versions: 0.3
> Environment: none
> Reporter: Brian Foster
> Assignee: Brian Foster
> Priority: Minor
> Fix For: 0.4
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (OODT-352) Integrate CAS-CLI into
CAS-Crawler
Posted by "Brian Foster (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OODT-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216571#comment-13216571 ]
Brian Foster edited comment on OODT-352 at 2/25/12 11:02 PM:
-------------------------------------------------------------
- Updates to support \-\-operation look-and-feel and legacy mode - just point your crawler_launcher option and action java properties at the legacy-*xml files and you've got the same command line as before... updated review board as well
was (Author: bfoster):
- Updates to support \-\-operation look-and-feel and legacy mode (just point your crawler_launcher option and action java properties at the legacy-*xml files and you've got the same command line as before... updated review board as well
> Integrate CAS-CLI into CAS-Crawler
> ----------------------------------
>
> Key: OODT-352
> URL: https://issues.apache.org/jira/browse/OODT-352
> Project: OODT
> Issue Type: Improvement
> Components: crawler
> Affects Versions: 0.3
> Environment: none
> Reporter: Brian Foster
> Assignee: Brian Foster
> Priority: Minor
> Fix For: 0.4
>
> Attachments: OODT-352.2012-02-10.patch.txt, OODT-352.2012-02-10.patch.txt, OODT-352.2012-02-25.patch.txt
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (OODT-352) Integrate CAS-CLI into
CAS-Crawler
Posted by "Brian Foster (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OODT-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13171157#comment-13171157 ]
Brian Foster edited comment on OODT-352 at 12/16/11 7:35 PM:
-------------------------------------------------------------
You'll just have to change these 2 lines in your crawler_launcher script:
{code}
It will be this:
-Dorg.apache.oodt.cas.cli.action.spring.config=../policy/cmd-line-actions.xml \
-Dorg.apache.oodt.cas.cli.option.spring.config=../policy/cmd-line-options.xml \
You'll change it to something like this:
-Dorg.apache.oodt.cas.cli.action.spring.config=../policy/fuddy-duddy/cmd-line-actions.xml \
-Dorg.apache.oodt.cas.cli.option.spring.config=../policy/fuddy-duddy/cmd-line-options.xml \
{code}
is that what you had in mind?
was (Author: bfoster):
You'll just have to change these 2 lines in your crawler_launcher script:
It will be this:
-Dorg.apache.oodt.cas.cli.action.spring.config=../policy/cmd-line-actions.xml \
-Dorg.apache.oodt.cas.cli.option.spring.config=../policy/cmd-line-options.xml \
You'll change it to something like this:
-Dorg.apache.oodt.cas.cli.action.spring.config=../policy/fuddy-duddy/cmd-line-actions.xml \
-Dorg.apache.oodt.cas.cli.option.spring.config=../policy/fuddy-duddy/cmd-line-options.xml \
is that what you had in mind?
> Integrate CAS-CLI into CAS-Crawler
> ----------------------------------
>
> Key: OODT-352
> URL: https://issues.apache.org/jira/browse/OODT-352
> Project: OODT
> Issue Type: Improvement
> Components: crawler
> Affects Versions: 0.3
> Environment: none
> Reporter: Brian Foster
> Assignee: Brian Foster
> Priority: Minor
> Fix For: 0.4
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OODT-352) Integrate CAS-CLI into CAS-Crawler
Posted by "Brian Foster (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OODT-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170600#comment-13170600 ]
Brian Foster commented on OODT-352:
-----------------------------------
this goes back to the dev list conversation about synchronizing the look of all the components... just trying to jump start the conversation again... if everyone wants to kept it the same I'm totally cool with that... however I believe there is value in all the command line looking the same... but if keeping the crawler command line interface the same has more value then I'll keep it the same
> Integrate CAS-CLI into CAS-Crawler
> ----------------------------------
>
> Key: OODT-352
> URL: https://issues.apache.org/jira/browse/OODT-352
> Project: OODT
> Issue Type: Improvement
> Components: crawler
> Affects Versions: 0.3
> Environment: none
> Reporter: Brian Foster
> Assignee: Brian Foster
> Priority: Minor
> Fix For: 0.4
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OODT-352) Integrate CAS-CLI into CAS-Crawler
Posted by "Brian Foster (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OODT-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13171121#comment-13171121 ]
Brian Foster commented on OODT-352:
-----------------------------------
sounds good... i will check-in 2 versions of the spring xml files... the default ones will uses the new --operation look... and then there will be a legacy set of spring files i will check in which if you just point your crawler at them instead will flip the crawler to fuddy duddy mode
> Integrate CAS-CLI into CAS-Crawler
> ----------------------------------
>
> Key: OODT-352
> URL: https://issues.apache.org/jira/browse/OODT-352
> Project: OODT
> Issue Type: Improvement
> Components: crawler
> Affects Versions: 0.3
> Environment: none
> Reporter: Brian Foster
> Assignee: Brian Foster
> Priority: Minor
> Fix For: 0.4
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OODT-352) Integrate CAS-CLI into CAS-Crawler
Posted by "Chris A. Mattmann (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OODT-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170627#comment-13170627 ]
Chris A. Mattmann commented on OODT-352:
----------------------------------------
Guys, I personally, for back compat, would like the old interface to remain.
I think a great compromise would be:
# Brian keep the old interface for back compat
# Brian make it support --operation <crawlerId> per his comment also, for those newer users who aren't old fuddy duddys like me with 50+ crawler scripts that exist in the EDRN repo that I'd have to update if this integration broke compat.
Deal?
> Integrate CAS-CLI into CAS-Crawler
> ----------------------------------
>
> Key: OODT-352
> URL: https://issues.apache.org/jira/browse/OODT-352
> Project: OODT
> Issue Type: Improvement
> Components: crawler
> Affects Versions: 0.3
> Environment: none
> Reporter: Brian Foster
> Assignee: Brian Foster
> Priority: Minor
> Fix For: 0.4
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (OODT-352) Integrate CAS-CLI into CAS-Crawler
Posted by "Paul Ramirez (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/OODT-352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13170614#comment-13170614 ]
Paul Ramirez commented on OODT-352:
-----------------------------------
Cool forgot about that and I agree if the command lines are similar across all components it makes it easier to consume. I was just concerned about a person upgrading and any script they may have written downstream. With this they have to update those downstream scripts to pass the crawler id in -op flag instead. Not necessarily horrible just a gotcha.
> Integrate CAS-CLI into CAS-Crawler
> ----------------------------------
>
> Key: OODT-352
> URL: https://issues.apache.org/jira/browse/OODT-352
> Project: OODT
> Issue Type: Improvement
> Components: crawler
> Affects Versions: 0.3
> Environment: none
> Reporter: Brian Foster
> Assignee: Brian Foster
> Priority: Minor
> Fix For: 0.4
>
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira