[jira] [Commented] (NUTCH-879) URL-s getting lost

["Lewis John McGibbney (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/NUTCH-879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13262171#comment-13262171 ] 

Lewis John McGibbney commented on NUTCH-879:
--------------------------------------------

This looks heliishly serious and pretty worrying actually. Ferdy (or anyone else), can you please run this against one of your HBase instances, I will do the same with Cassandra and we can determine what is going on here. 
                
> URL-s getting lost
> ------------------
>
>                 Key: NUTCH-879
>                 URL: https://issues.apache.org/jira/browse/NUTCH-879
>             Project: Nutch
>          Issue Type: Bug
>    Affects Versions: nutchgora
>         Environment: * Ubuntu 10.4 x64, Sun JDK 1.6
> * using 1-node Hadoop + HDFS
> * trunk r983472, using MySQL store
> * branch-1.3
>            Reporter: Andrzej Bialecki 
>             Fix For: nutchgora
>
>         Attachments: branch-1.3-bench.txt, trunk-bench.txt
>
>
> I ran the Benchmark using branch-1.3 and trunk (formerly nutchbase). With the same Benchmark parameters and the same plugins branch-1.3 collects ~1.5mln urls, while trunk collects ~20,000 urls. Clearly something is wrong.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira