You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Etienne Chauchot (Jira)" <ji...@apache.org> on 2021/10/28 10:30:00 UTC

[jira] [Created] (BEAM-13137) make ElasticsearchIO$BoundedElasticsearchSource#getEstimatedSizeBytes deterministic

Etienne Chauchot created BEAM-13137:
---------------------------------------

             Summary: make ElasticsearchIO$BoundedElasticsearchSource#getEstimatedSizeBytes deterministic
                 Key: BEAM-13137
                 URL: https://issues.apache.org/jira/browse/BEAM-13137
             Project: Beam
          Issue Type: Improvement
          Components: io-java-elasticsearch
            Reporter: Etienne Chauchot
            Assignee: Evan Galpin


Index size estimation is statistical in ES and varies. But it is the base for splitting so it needs to be more deterministic because that causes flakiness in the UTests in _testSplit_ and _testSizes_ and maybe entails sub-optimal splitting in production in some cases.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)