You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@oodt.apache.org by "Thomas Bennett (Created) (JIRA)" <ji...@apache.org> on 2012/03/23 08:37:34 UTC

[jira] [Created] (OODT-430) CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options like noRecur

CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options like noRecur
---------------------------------------------------------------------------------------------------------------

                 Key: OODT-430
                 URL: https://issues.apache.org/jira/browse/OODT-430
             Project: OODT
          Issue Type: Bug
          Components: crawler
    Affects Versions: 0.4
            Reporter: Thomas Bennett
            Priority: Minor
             Fix For: 0.4


Executing the crawler with --noRecur command line option throws the following exception:

Executed command:
java ... --operation --launchAutoCrawler... --productPath /var/kat/data.. --noRecur

Output:
Setting property 'StdProductCrawler.filemgrUrl'
Setting property 'MetExtractorProductCrawler.filemgrUrl'
Setting property 'AutoDetectProductCrawler.filemgrUrl'
Setting property 'StdProductCrawler.clientTransferer'
Setting property 'MetExtractorProductCrawler.clientTransferer'
Setting property 'AutoDetectProductCrawler.clientTransferer'
Setting property 'AutoDetectProductCrawler.mimeExtractorRepo'
Setting property 'MoveMetadataFileToFailureDir.toDir'
Setting property 'MovePushpullMetFileToFailureDir.toDir'
Setting property 'MoveDataFileToFailureDir.toDir'
Exception in thread "main" java.lang.RuntimeException: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
	at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:191)
	at org.apache.oodt.cas.crawl.CrawlerLauncher.main(CrawlerLauncher.java:36)
Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
	at java.util.ArrayList.rangeCheck(ArrayList.java:571)
	at java.util.ArrayList.get(ArrayList.java:349)
	at org.apache.oodt.cas.crawl.cli.option.handler.CrawlerBeansPropHandler.handleOption(CrawlerBeansPropHandler.java:56)
	at org.apache.oodt.cas.cli.util.CmdLineUtils.handle(CmdLineUtils.java:1034)
	at org.apache.oodt.cas.cli.CmdLineUtility.handle(CmdLineUtility.java:383)
	at org.apache.oodt.cas.cli.CmdLineUtility.execute(CmdLineUtility.java:328)
	at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:187)
	... 1 more


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Re: [jira] [Commented] (OODT-430) CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options like noRecur

Posted by "Mattmann, Chris A (388J)" <ch...@jpl.nasa.gov>.
Great work guys!

Cheers,
Chris

On Mar 23, 2012, at 11:59 AM, Thomas Bennett wrote:

> Hey Brian,
> 
> Thanks for the help sorting this out.
> 
> I'm happy to take over writing the unit tests ;-) no problem. 
> 
> I'll check out some of your other unit tests and let you know if I get stuck.
> 
> Cheers,
> Tom
> 
> Sent from my iPhone
> 
> On 23 Mar 2012, at 7:23 PM, "Brian Foster (Commented) (JIRA)" <ji...@apache.org> wrote:
> 
>> 
>>   [ https://issues.apache.org/jira/browse/OODT-430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236801#comment-13236801 ] 
>> 
>> Brian Foster commented on OODT-430:
>> -----------------------------------
>> 
>> i just need to add a bunch of unit-tests for crawler cli usages like i did for filegr, wmgr, and resmgr... by the time i got to the crawler i was so sick of writing cas-cli unit-tests i just said screw it and check it in... lol... glad you are using it though and helping smoke out the bugs!... these unit-tests are on my list of things to do though!
>> 
>>> CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options like noRecur
>>> ---------------------------------------------------------------------------------------------------------------
>>> 
>>>               Key: OODT-430
>>>               URL: https://issues.apache.org/jira/browse/OODT-430
>>>           Project: OODT
>>>        Issue Type: Bug
>>>        Components: crawler
>>>  Affects Versions: 0.4
>>>          Reporter: Thomas Bennett
>>>          Priority: Minor
>>>            Labels: patch
>>>           Fix For: 0.4
>>> 
>>> 
>>> Executing the crawler with --noRecur command line option throws the following exception:
>>> Executed command:
>>> java ... --operation --launchAutoCrawler... --productPath /var/kat/data.. --noRecur
>>> Output:
>>> Setting property 'StdProductCrawler.filemgrUrl'
>>> Setting property 'MetExtractorProductCrawler.filemgrUrl'
>>> Setting property 'AutoDetectProductCrawler.filemgrUrl'
>>> Setting property 'StdProductCrawler.clientTransferer'
>>> Setting property 'MetExtractorProductCrawler.clientTransferer'
>>> Setting property 'AutoDetectProductCrawler.clientTransferer'
>>> Setting property 'AutoDetectProductCrawler.mimeExtractorRepo'
>>> Setting property 'MoveMetadataFileToFailureDir.toDir'
>>> Setting property 'MovePushpullMetFileToFailureDir.toDir'
>>> Setting property 'MoveDataFileToFailureDir.toDir'
>>> Exception in thread "main" java.lang.RuntimeException: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
>>>   at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:191)
>>>   at org.apache.oodt.cas.crawl.CrawlerLauncher.main(CrawlerLauncher.java:36)
>>> Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
>>>   at java.util.ArrayList.rangeCheck(ArrayList.java:571)
>>>   at java.util.ArrayList.get(ArrayList.java:349)
>>>   at org.apache.oodt.cas.crawl.cli.option.handler.CrawlerBeansPropHandler.handleOption(CrawlerBeansPropHandler.java:56)
>>>   at org.apache.oodt.cas.cli.util.CmdLineUtils.handle(CmdLineUtils.java:1034)
>>>   at org.apache.oodt.cas.cli.CmdLineUtility.handle(CmdLineUtility.java:383)
>>>   at org.apache.oodt.cas.cli.CmdLineUtility.execute(CmdLineUtility.java:328)
>>>   at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:187)
>>>   ... 1 more
>> 
>> --
>> This message is automatically generated by JIRA.
>> If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
>> For more information on JIRA, see: http://www.atlassian.com/software/jira
>> 
>> 


++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Chris Mattmann, Ph.D.
Senior Computer Scientist
NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA
Office: 171-266B, Mailstop: 171-246
Email: chris.a.mattmann@nasa.gov
WWW:   http://sunset.usc.edu/~mattmann/
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Adjunct Assistant Professor, Computer Science Department
University of Southern California, Los Angeles, CA 90089 USA
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++


Re: [jira] [Commented] (OODT-430) CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options like noRecur

Posted by Thomas Bennett <lm...@gmail.com>.
Hey Brian,

Thanks for the help sorting this out.

I'm happy to take over writing the unit tests ;-) no problem. 

I'll check out some of your other unit tests and let you know if I get stuck.

Cheers,
Tom

Sent from my iPhone

On 23 Mar 2012, at 7:23 PM, "Brian Foster (Commented) (JIRA)" <ji...@apache.org> wrote:

> 
>    [ https://issues.apache.org/jira/browse/OODT-430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236801#comment-13236801 ] 
> 
> Brian Foster commented on OODT-430:
> -----------------------------------
> 
> i just need to add a bunch of unit-tests for crawler cli usages like i did for filegr, wmgr, and resmgr... by the time i got to the crawler i was so sick of writing cas-cli unit-tests i just said screw it and check it in... lol... glad you are using it though and helping smoke out the bugs!... these unit-tests are on my list of things to do though!
> 
>> CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options like noRecur
>> ---------------------------------------------------------------------------------------------------------------
>> 
>>                Key: OODT-430
>>                URL: https://issues.apache.org/jira/browse/OODT-430
>>            Project: OODT
>>         Issue Type: Bug
>>         Components: crawler
>>   Affects Versions: 0.4
>>           Reporter: Thomas Bennett
>>           Priority: Minor
>>             Labels: patch
>>            Fix For: 0.4
>> 
>> 
>> Executing the crawler with --noRecur command line option throws the following exception:
>> Executed command:
>> java ... --operation --launchAutoCrawler... --productPath /var/kat/data.. --noRecur
>> Output:
>> Setting property 'StdProductCrawler.filemgrUrl'
>> Setting property 'MetExtractorProductCrawler.filemgrUrl'
>> Setting property 'AutoDetectProductCrawler.filemgrUrl'
>> Setting property 'StdProductCrawler.clientTransferer'
>> Setting property 'MetExtractorProductCrawler.clientTransferer'
>> Setting property 'AutoDetectProductCrawler.clientTransferer'
>> Setting property 'AutoDetectProductCrawler.mimeExtractorRepo'
>> Setting property 'MoveMetadataFileToFailureDir.toDir'
>> Setting property 'MovePushpullMetFileToFailureDir.toDir'
>> Setting property 'MoveDataFileToFailureDir.toDir'
>> Exception in thread "main" java.lang.RuntimeException: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
>>    at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:191)
>>    at org.apache.oodt.cas.crawl.CrawlerLauncher.main(CrawlerLauncher.java:36)
>> Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
>>    at java.util.ArrayList.rangeCheck(ArrayList.java:571)
>>    at java.util.ArrayList.get(ArrayList.java:349)
>>    at org.apache.oodt.cas.crawl.cli.option.handler.CrawlerBeansPropHandler.handleOption(CrawlerBeansPropHandler.java:56)
>>    at org.apache.oodt.cas.cli.util.CmdLineUtils.handle(CmdLineUtils.java:1034)
>>    at org.apache.oodt.cas.cli.CmdLineUtility.handle(CmdLineUtility.java:383)
>>    at org.apache.oodt.cas.cli.CmdLineUtility.execute(CmdLineUtility.java:328)
>>    at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:187)
>>    ... 1 more
> 
> --
> This message is automatically generated by JIRA.
> If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
> For more information on JIRA, see: http://www.atlassian.com/software/jira
> 
> 

[jira] [Commented] (OODT-430) CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options like noRecur

Posted by "Brian Foster (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OODT-430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236801#comment-13236801 ] 

Brian Foster commented on OODT-430:
-----------------------------------

i just need to add a bunch of unit-tests for crawler cli usages like i did for filegr, wmgr, and resmgr... by the time i got to the crawler i was so sick of writing cas-cli unit-tests i just said screw it and check it in... lol... glad you are using it though and helping smoke out the bugs!... these unit-tests are on my list of things to do though!
                
> CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options like noRecur
> ---------------------------------------------------------------------------------------------------------------
>
>                 Key: OODT-430
>                 URL: https://issues.apache.org/jira/browse/OODT-430
>             Project: OODT
>          Issue Type: Bug
>          Components: crawler
>    Affects Versions: 0.4
>            Reporter: Thomas Bennett
>            Priority: Minor
>              Labels: patch
>             Fix For: 0.4
>
>
> Executing the crawler with --noRecur command line option throws the following exception:
> Executed command:
> java ... --operation --launchAutoCrawler... --productPath /var/kat/data.. --noRecur
> Output:
> Setting property 'StdProductCrawler.filemgrUrl'
> Setting property 'MetExtractorProductCrawler.filemgrUrl'
> Setting property 'AutoDetectProductCrawler.filemgrUrl'
> Setting property 'StdProductCrawler.clientTransferer'
> Setting property 'MetExtractorProductCrawler.clientTransferer'
> Setting property 'AutoDetectProductCrawler.clientTransferer'
> Setting property 'AutoDetectProductCrawler.mimeExtractorRepo'
> Setting property 'MoveMetadataFileToFailureDir.toDir'
> Setting property 'MovePushpullMetFileToFailureDir.toDir'
> Setting property 'MoveDataFileToFailureDir.toDir'
> Exception in thread "main" java.lang.RuntimeException: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
> 	at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:191)
> 	at org.apache.oodt.cas.crawl.CrawlerLauncher.main(CrawlerLauncher.java:36)
> Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
> 	at java.util.ArrayList.rangeCheck(ArrayList.java:571)
> 	at java.util.ArrayList.get(ArrayList.java:349)
> 	at org.apache.oodt.cas.crawl.cli.option.handler.CrawlerBeansPropHandler.handleOption(CrawlerBeansPropHandler.java:56)
> 	at org.apache.oodt.cas.cli.util.CmdLineUtils.handle(CmdLineUtils.java:1034)
> 	at org.apache.oodt.cas.cli.CmdLineUtility.handle(CmdLineUtility.java:383)
> 	at org.apache.oodt.cas.cli.CmdLineUtility.execute(CmdLineUtility.java:328)
> 	at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:187)
> 	... 1 more

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (OODT-430) CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options like noRecur

Posted by "Thomas Bennett (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OODT-430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236457#comment-13236457 ] 

Thomas Bennett commented on OODT-430:
-------------------------------------

Hi Brian,

Great! I've been digging around in the code to see how it all works, so you've saved me some time :)

I've tested it and it works.

Shall I find all the booleans in all the utilities and get a patch together?
                
> CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options like noRecur
> ---------------------------------------------------------------------------------------------------------------
>
>                 Key: OODT-430
>                 URL: https://issues.apache.org/jira/browse/OODT-430
>             Project: OODT
>          Issue Type: Bug
>          Components: crawler
>    Affects Versions: 0.4
>            Reporter: Thomas Bennett
>            Priority: Minor
>              Labels: patch
>             Fix For: 0.4
>
>
> Executing the crawler with --noRecur command line option throws the following exception:
> Executed command:
> java ... --operation --launchAutoCrawler... --productPath /var/kat/data.. --noRecur
> Output:
> Setting property 'StdProductCrawler.filemgrUrl'
> Setting property 'MetExtractorProductCrawler.filemgrUrl'
> Setting property 'AutoDetectProductCrawler.filemgrUrl'
> Setting property 'StdProductCrawler.clientTransferer'
> Setting property 'MetExtractorProductCrawler.clientTransferer'
> Setting property 'AutoDetectProductCrawler.clientTransferer'
> Setting property 'AutoDetectProductCrawler.mimeExtractorRepo'
> Setting property 'MoveMetadataFileToFailureDir.toDir'
> Setting property 'MovePushpullMetFileToFailureDir.toDir'
> Setting property 'MoveDataFileToFailureDir.toDir'
> Exception in thread "main" java.lang.RuntimeException: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
> 	at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:191)
> 	at org.apache.oodt.cas.crawl.CrawlerLauncher.main(CrawlerLauncher.java:36)
> Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
> 	at java.util.ArrayList.rangeCheck(ArrayList.java:571)
> 	at java.util.ArrayList.get(ArrayList.java:349)
> 	at org.apache.oodt.cas.crawl.cli.option.handler.CrawlerBeansPropHandler.handleOption(CrawlerBeansPropHandler.java:56)
> 	at org.apache.oodt.cas.cli.util.CmdLineUtils.handle(CmdLineUtils.java:1034)
> 	at org.apache.oodt.cas.cli.CmdLineUtility.handle(CmdLineUtility.java:383)
> 	at org.apache.oodt.cas.cli.CmdLineUtility.execute(CmdLineUtility.java:328)
> 	at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:187)
> 	... 1 more

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Assigned] (OODT-430) CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options like noRecur

Posted by "Thomas Bennett (Assigned) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/OODT-430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Bennett reassigned OODT-430:
-----------------------------------

    Assignee: Thomas Bennett
    
> CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options like noRecur
> ---------------------------------------------------------------------------------------------------------------
>
>                 Key: OODT-430
>                 URL: https://issues.apache.org/jira/browse/OODT-430
>             Project: OODT
>          Issue Type: Bug
>          Components: crawler
>    Affects Versions: 0.4
>            Reporter: Thomas Bennett
>            Assignee: Thomas Bennett
>            Priority: Minor
>              Labels: patch
>             Fix For: 0.4
>
>
> Executing the crawler with --noRecur command line option throws the following exception:
> Executed command:
> java ... --operation --launchAutoCrawler... --productPath /var/kat/data.. --noRecur
> Output:
> Setting property 'StdProductCrawler.filemgrUrl'
> Setting property 'MetExtractorProductCrawler.filemgrUrl'
> Setting property 'AutoDetectProductCrawler.filemgrUrl'
> Setting property 'StdProductCrawler.clientTransferer'
> Setting property 'MetExtractorProductCrawler.clientTransferer'
> Setting property 'AutoDetectProductCrawler.clientTransferer'
> Setting property 'AutoDetectProductCrawler.mimeExtractorRepo'
> Setting property 'MoveMetadataFileToFailureDir.toDir'
> Setting property 'MovePushpullMetFileToFailureDir.toDir'
> Setting property 'MoveDataFileToFailureDir.toDir'
> Exception in thread "main" java.lang.RuntimeException: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
> 	at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:191)
> 	at org.apache.oodt.cas.crawl.CrawlerLauncher.main(CrawlerLauncher.java:36)
> Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
> 	at java.util.ArrayList.rangeCheck(ArrayList.java:571)
> 	at java.util.ArrayList.get(ArrayList.java:349)
> 	at org.apache.oodt.cas.crawl.cli.option.handler.CrawlerBeansPropHandler.handleOption(CrawlerBeansPropHandler.java:56)
> 	at org.apache.oodt.cas.cli.util.CmdLineUtils.handle(CmdLineUtils.java:1034)
> 	at org.apache.oodt.cas.cli.CmdLineUtility.handle(CmdLineUtility.java:383)
> 	at org.apache.oodt.cas.cli.CmdLineUtility.execute(CmdLineUtility.java:328)
> 	at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:187)
> 	... 1 more

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (OODT-430) CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options like noRecur

Posted by "Thomas Bennett (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OODT-430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236436#comment-13236436 ] 

Thomas Bennett commented on OODT-430:
-------------------------------------

I see there is a test for this - TestBooleanOptions.java - which passes.
                
> CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options like noRecur
> ---------------------------------------------------------------------------------------------------------------
>
>                 Key: OODT-430
>                 URL: https://issues.apache.org/jira/browse/OODT-430
>             Project: OODT
>          Issue Type: Bug
>          Components: crawler
>    Affects Versions: 0.4
>            Reporter: Thomas Bennett
>            Priority: Minor
>              Labels: patch
>             Fix For: 0.4
>
>
> Executing the crawler with --noRecur command line option throws the following exception:
> Executed command:
> java ... --operation --launchAutoCrawler... --productPath /var/kat/data.. --noRecur
> Output:
> Setting property 'StdProductCrawler.filemgrUrl'
> Setting property 'MetExtractorProductCrawler.filemgrUrl'
> Setting property 'AutoDetectProductCrawler.filemgrUrl'
> Setting property 'StdProductCrawler.clientTransferer'
> Setting property 'MetExtractorProductCrawler.clientTransferer'
> Setting property 'AutoDetectProductCrawler.clientTransferer'
> Setting property 'AutoDetectProductCrawler.mimeExtractorRepo'
> Setting property 'MoveMetadataFileToFailureDir.toDir'
> Setting property 'MovePushpullMetFileToFailureDir.toDir'
> Setting property 'MoveDataFileToFailureDir.toDir'
> Exception in thread "main" java.lang.RuntimeException: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
> 	at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:191)
> 	at org.apache.oodt.cas.crawl.CrawlerLauncher.main(CrawlerLauncher.java:36)
> Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
> 	at java.util.ArrayList.rangeCheck(ArrayList.java:571)
> 	at java.util.ArrayList.get(ArrayList.java:349)
> 	at org.apache.oodt.cas.crawl.cli.option.handler.CrawlerBeansPropHandler.handleOption(CrawlerBeansPropHandler.java:56)
> 	at org.apache.oodt.cas.cli.util.CmdLineUtils.handle(CmdLineUtils.java:1034)
> 	at org.apache.oodt.cas.cli.CmdLineUtility.handle(CmdLineUtility.java:383)
> 	at org.apache.oodt.cas.cli.CmdLineUtility.execute(CmdLineUtility.java:328)
> 	at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:187)
> 	... 1 more

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (OODT-430) CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options like noRecur

Posted by "Brian Foster (Commented) (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/OODT-430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13236445#comment-13236445 ] 

Brian Foster commented on OODT-430:
-----------------------------------

This is gonna apply to all boolean types i imagine... --skipInject... etc... the problem is --noRecur should be marked as type boolean with a static arg of true... changes needed are pointed out below:

{code:xml} 
        <bean id="noRecur" class="org.apache.oodt.cas.cli.option.AdvancedCmdLineOption">
                <property name="shortOption" value="nr" />
                <property name="longOption" value="noRecur" />
                <property name="description" value="Turns off recursive crawling - will only process files in productPath directory" />

                <!-- boolean type added here -->
                <property name="type" value="boolean" />
                <!-- end add boolean type -->

                <property name="hasArgs" value="false" />

                <!-- static arg true added here -->
                <property name="staticArgs">
                        <list>
                                <value>true</value>
                        </list>
                </property>
                <!-- end add static arg true -->

                <property name="requirementRules">
                        <list>
                                <bean class="org.apache.oodt.cas.cli.option.require.ActionDependencyRule"
                                        p:actionName="launchStdCrawler" p:relation="OPTIONAL" />
                                <bean class="org.apache.oodt.cas.cli.option.require.ActionDependencyRule"
                                        p:actionName="launchMetCrawler" p:relation="OPTIONAL" />
                                <bean class="org.apache.oodt.cas.cli.option.require.ActionDependencyRule"
                                        p:actionName="launchAutoCrawler" p:relation="OPTIONAL" />
                        </list>
                </property>
                <property name="handler">
                        <bean class="org.apache.oodt.cas.crawl.cli.option.handler.CrawlerBeansPropHandler">
                                <property name="properties">
                                        <list>
                                                <value>StdProductCrawler.noRecur</value>
                                                <value>MetExtractorProductCrawler.noRecur</value>
                                                <value>AutoDetectProductCrawler.noRecur</value>
                                        </list>
                                </property>
                        </bean>
                </property>
        </bean>
{code} 
                
> CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options like noRecur
> ---------------------------------------------------------------------------------------------------------------
>
>                 Key: OODT-430
>                 URL: https://issues.apache.org/jira/browse/OODT-430
>             Project: OODT
>          Issue Type: Bug
>          Components: crawler
>    Affects Versions: 0.4
>            Reporter: Thomas Bennett
>            Priority: Minor
>              Labels: patch
>             Fix For: 0.4
>
>
> Executing the crawler with --noRecur command line option throws the following exception:
> Executed command:
> java ... --operation --launchAutoCrawler... --productPath /var/kat/data.. --noRecur
> Output:
> Setting property 'StdProductCrawler.filemgrUrl'
> Setting property 'MetExtractorProductCrawler.filemgrUrl'
> Setting property 'AutoDetectProductCrawler.filemgrUrl'
> Setting property 'StdProductCrawler.clientTransferer'
> Setting property 'MetExtractorProductCrawler.clientTransferer'
> Setting property 'AutoDetectProductCrawler.clientTransferer'
> Setting property 'AutoDetectProductCrawler.mimeExtractorRepo'
> Setting property 'MoveMetadataFileToFailureDir.toDir'
> Setting property 'MovePushpullMetFileToFailureDir.toDir'
> Setting property 'MoveDataFileToFailureDir.toDir'
> Exception in thread "main" java.lang.RuntimeException: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
> 	at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:191)
> 	at org.apache.oodt.cas.crawl.CrawlerLauncher.main(CrawlerLauncher.java:36)
> Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
> 	at java.util.ArrayList.rangeCheck(ArrayList.java:571)
> 	at java.util.ArrayList.get(ArrayList.java:349)
> 	at org.apache.oodt.cas.crawl.cli.option.handler.CrawlerBeansPropHandler.handleOption(CrawlerBeansPropHandler.java:56)
> 	at org.apache.oodt.cas.cli.util.CmdLineUtils.handle(CmdLineUtils.java:1034)
> 	at org.apache.oodt.cas.cli.CmdLineUtility.handle(CmdLineUtility.java:383)
> 	at org.apache.oodt.cas.cli.CmdLineUtility.execute(CmdLineUtility.java:328)
> 	at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:187)
> 	... 1 more

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Closed] (OODT-430) CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options like noRecur

Posted by "Thomas Bennett (Closed) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/OODT-430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Bennett closed OODT-430.
-------------------------------

    
> CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options like noRecur
> ---------------------------------------------------------------------------------------------------------------
>
>                 Key: OODT-430
>                 URL: https://issues.apache.org/jira/browse/OODT-430
>             Project: OODT
>          Issue Type: Bug
>          Components: crawler
>    Affects Versions: 0.4
>            Reporter: Thomas Bennett
>            Assignee: Thomas Bennett
>            Priority: Minor
>              Labels: patch
>             Fix For: 0.4
>
>
> Executing the crawler with --noRecur command line option throws the following exception:
> Executed command:
> java ... --operation --launchAutoCrawler... --productPath /var/kat/data.. --noRecur
> Output:
> Setting property 'StdProductCrawler.filemgrUrl'
> Setting property 'MetExtractorProductCrawler.filemgrUrl'
> Setting property 'AutoDetectProductCrawler.filemgrUrl'
> Setting property 'StdProductCrawler.clientTransferer'
> Setting property 'MetExtractorProductCrawler.clientTransferer'
> Setting property 'AutoDetectProductCrawler.clientTransferer'
> Setting property 'AutoDetectProductCrawler.mimeExtractorRepo'
> Setting property 'MoveMetadataFileToFailureDir.toDir'
> Setting property 'MovePushpullMetFileToFailureDir.toDir'
> Setting property 'MoveDataFileToFailureDir.toDir'
> Exception in thread "main" java.lang.RuntimeException: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
> 	at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:191)
> 	at org.apache.oodt.cas.crawl.CrawlerLauncher.main(CrawlerLauncher.java:36)
> Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
> 	at java.util.ArrayList.rangeCheck(ArrayList.java:571)
> 	at java.util.ArrayList.get(ArrayList.java:349)
> 	at org.apache.oodt.cas.crawl.cli.option.handler.CrawlerBeansPropHandler.handleOption(CrawlerBeansPropHandler.java:56)
> 	at org.apache.oodt.cas.cli.util.CmdLineUtils.handle(CmdLineUtils.java:1034)
> 	at org.apache.oodt.cas.cli.CmdLineUtility.handle(CmdLineUtility.java:383)
> 	at org.apache.oodt.cas.cli.CmdLineUtility.execute(CmdLineUtility.java:328)
> 	at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:187)
> 	... 1 more

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (OODT-430) CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options like noRecur

Posted by "Thomas Bennett (Resolved) (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/OODT-430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Thomas Bennett resolved OODT-430.
---------------------------------

    Resolution: Fixed

Fixed thanks to Brian's input.
                
> CrawlerBeansPropHandler throws IndexOutOfBoundsException when parsing boolean command line options like noRecur
> ---------------------------------------------------------------------------------------------------------------
>
>                 Key: OODT-430
>                 URL: https://issues.apache.org/jira/browse/OODT-430
>             Project: OODT
>          Issue Type: Bug
>          Components: crawler
>    Affects Versions: 0.4
>            Reporter: Thomas Bennett
>            Assignee: Thomas Bennett
>            Priority: Minor
>              Labels: patch
>             Fix For: 0.4
>
>
> Executing the crawler with --noRecur command line option throws the following exception:
> Executed command:
> java ... --operation --launchAutoCrawler... --productPath /var/kat/data.. --noRecur
> Output:
> Setting property 'StdProductCrawler.filemgrUrl'
> Setting property 'MetExtractorProductCrawler.filemgrUrl'
> Setting property 'AutoDetectProductCrawler.filemgrUrl'
> Setting property 'StdProductCrawler.clientTransferer'
> Setting property 'MetExtractorProductCrawler.clientTransferer'
> Setting property 'AutoDetectProductCrawler.clientTransferer'
> Setting property 'AutoDetectProductCrawler.mimeExtractorRepo'
> Setting property 'MoveMetadataFileToFailureDir.toDir'
> Setting property 'MovePushpullMetFileToFailureDir.toDir'
> Setting property 'MoveDataFileToFailureDir.toDir'
> Exception in thread "main" java.lang.RuntimeException: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
> 	at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:191)
> 	at org.apache.oodt.cas.crawl.CrawlerLauncher.main(CrawlerLauncher.java:36)
> Caused by: java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
> 	at java.util.ArrayList.rangeCheck(ArrayList.java:571)
> 	at java.util.ArrayList.get(ArrayList.java:349)
> 	at org.apache.oodt.cas.crawl.cli.option.handler.CrawlerBeansPropHandler.handleOption(CrawlerBeansPropHandler.java:56)
> 	at org.apache.oodt.cas.cli.util.CmdLineUtils.handle(CmdLineUtils.java:1034)
> 	at org.apache.oodt.cas.cli.CmdLineUtility.handle(CmdLineUtility.java:383)
> 	at org.apache.oodt.cas.cli.CmdLineUtility.execute(CmdLineUtility.java:328)
> 	at org.apache.oodt.cas.cli.CmdLineUtility.run(CmdLineUtility.java:187)
> 	... 1 more

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira