You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Andrew Kyle Purtell (Jira)" <ji...@apache.org> on 2021/10/11 20:17:00 UTC

[jira] [Created] (HBASE-26349) Revert and improve recent change to IntegrationTestLoadCommonCrawl

Andrew Kyle Purtell created HBASE-26349:
-------------------------------------------

             Summary: Revert and improve recent change to IntegrationTestLoadCommonCrawl
                 Key: HBASE-26349
                 URL: https://issues.apache.org/jira/browse/HBASE-26349
             Project: HBase
          Issue Type: Test
          Components: integration tests, test
    Affects Versions: 2.5.0
            Reporter: Andrew Kyle Purtell
            Assignee: Andrew Kyle Purtell
             Fix For: 3.0.0-alpha-2


Using BufferedMutator wasn't a good idea because we assign client timestamps, and the store loop is fast enough that on rare occasion two adjacent URLs in a WARC are equivalent and the timestamp does not advance, leading later to a rare false positive CORRUPT finding. 

While making changes, support direct S3N paths as input paths on the command line.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)