[jira] [Created] (HDDS-1105) Create an OM API that takes in a RocksDB sequence number and attempts to return all transactions after that.

["Aravindan Vijayan (JIRA)" <ji...@apache.org>]

Aravindan Vijayan created HDDS-1105:
---------------------------------------

             Summary: Create an OM API that takes in a RocksDB sequence number and attempts to return all transactions after that.
                 Key: HDDS-1105
                 URL: https://issues.apache.org/jira/browse/HDDS-1105
             Project: Hadoop Distributed Data Store
          Issue Type: Sub-task
            Reporter: Aravindan Vijayan
            Assignee: Aravindan Vijayan


*Some context*

The FSCK server will periodically invoke this OM API passing in the most recent sequence number of its own RocksDB instance. The OM will use the RockDB getUpdateSince() API to answer this query. Since the getUpdateSince API only works against the RocksDB WAL, we have to configure OM RocksDB WAL (https://github.com/facebook/rocksdb/wiki/Write-Ahead-Log) with sufficient max size to make this API useful. If the OM cannot get all transactions since the given sequence number (due to WAL flushing), it can error out. In that case the FSCK server can fall back to getting the entire checkpoint snapshot implemented in HDDS-1085.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-help@hadoop.apache.org