[jira] [Created] (KUDU-3260) Reduce the on-disk footprint of transaction metadata in participants

["Andrew Wong (Jira)" <ji...@apache.org>]

Andrew Wong created KUDU-3260:
---------------------------------

             Summary: Reduce the on-disk footprint of transaction metadata in participants
                 Key: KUDU-3260
                 URL: https://issues.apache.org/jira/browse/KUDU-3260
             Project: Kudu
          Issue Type: Improvement
          Components: server, transactions
            Reporter: Andrew Wong


We should remove the commit timestamp and txn metadata once we've flushed all in-memory stores that rely on metadata for determining commit timestamp. If we see tablets serving more frequent transactions, the persisted metadata may become less negligible.

One thing to watch out for here is that we currently use metadata to determine whether a transaction has _ever_ existed on the participant – if we simply get rid of the metadata, we will lose out on this knowledge. More thought should be given to how and when to do this safely, and ensure that we clean up the metadata in such a way that no invariants are broken with regards to knowing about transaction existence (e.g. perhaps only clean up the txn metadata if the corresponding TxnStatusManager has been deleted?).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)