You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "ROMAN NAZARENKO (JIRA)" <ji...@apache.org> on 2018/04/10 17:23:00 UTC
[jira] [Created] (SOLR-12210) Perfomance degradation at Hghi Load
ROMAN NAZARENKO created SOLR-12210:
--------------------------------------
Summary: Perfomance degradation at Hghi Load
Key: SOLR-12210
URL: https://issues.apache.org/jira/browse/SOLR-12210
Project: Solr
Issue Type: Bug
Security Level: Public (Default Security Level. Issues are Public)
Components: Hadoop Integration
Affects Versions: 7.2
Reporter: ROMAN NAZARENKO
When hdfsDataFactory is used and the incoming data stream is large, the rate of indexation is degraded. This is not a problem when using a local file system. I think the problem is in cleaning hdfsBlockCache. Because the degradation of the indexing rate occurs precisely when this cache reaches its maximum value. The basis for hdfsBlockCache is caffeine cache, but it is configured to clean only when the maximum size is reached. At the same time, nothing prevents using timeEviction, I suggest testing the indexing speed using this type of cache cleaning.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org