[jira] [Created] (HDFS-16967) RBF: File based state stores should allow concurrent access to the records

["Viraj Jasani (Jira)" <ji...@apache.org>]

Viraj Jasani created HDFS-16967:
-----------------------------------

             Summary: RBF: File based state stores should allow concurrent access to the records
                 Key: HDFS-16967
                 URL: https://issues.apache.org/jira/browse/HDFS-16967
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: Viraj Jasani
            Assignee: Viraj Jasani


File based state store implementations (StateStoreFileImpl and StateStoreFileSystemImpl) should allow updating as well as reading of the state store records concurrently rather than serially. Concurrent access to the record files on the hdfs based store seems to be improving the state store cache loading performance by more than 10x.

For instance, in order to maintain data integrity, when any mount table record(s) is updated, the cache is reloaded. This reload operation seems to be able to gain significant performance improvement by the concurrent access of the mount table records.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org