You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@hbase.apache.org by "Andrew Kyle Purtell (Jira)" <ji...@apache.org> on 2022/06/11 23:43:00 UTC

[jira] [Closed] (HBASE-2602) full system application test scenario: webtable

     [ https://issues.apache.org/jira/browse/HBASE-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Kyle Purtell closed HBASE-2602.
--------------------------------------

> full system application test scenario: webtable
> -----------------------------------------------
>
>                 Key: HBASE-2602
>                 URL: https://issues.apache.org/jira/browse/HBASE-2602
>             Project: HBase
>          Issue Type: Sub-task
>            Reporter: Andrew Kyle Purtell
>            Priority: Major
>
> Put together a full web content archive toolchain:
> * Pluggable content acquisition
>     ** Heritrix HBase writer simulator, zipf distribution over [32B, 10MB]
>     ** Real Heritrix + Heritrix HBase writer option for running crawls over live sites
> * Periodic MapReduce using Tika for extraction
> * Katta for search, or hbasene + Solr when ready (better)



--
This message was sent by Atlassian Jira
(v8.20.7#820007)