You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@tika.apache.org by "Tim Allison (Jira)" <ji...@apache.org> on 2021/01/29 22:01:00 UTC

[jira] [Created] (TIKA-3288) Allow batching for emitters

Tim Allison created TIKA-3288:
---------------------------------

             Summary: Allow batching for emitters
                 Key: TIKA-3288
                 URL: https://issues.apache.org/jira/browse/TIKA-3288
             Project: Tika
          Issue Type: Task
          Components: tika-pipes
            Reporter: Tim Allison


Started an interface in comments: [https://github.com/apache/tika/blob/main/tika-core/src/main/java/org/apache/tika/pipes/emitter/Emitter.java#L34]

 

The AbstractEmitter can keep track of "batch size" – how many bytes are in the batch.  The caller can check for that after each addition and then call executeBatch, or at the end of the task list.

 

We'll have to have a separate handler in tika-server `async-emit` ( ? ) to handle this.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)