You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@horaedb.apache.org by "LeslieKid (via GitHub)" <gi...@apache.org> on 2024/09/20 04:57:01 UTC
[I] Integration test for compaction [horaedb]
LeslieKid opened a new issue, #1571:
URL: https://github.com/apache/horaedb/issues/1571
### Describe This Problem
The subproblem for #1545 .
Currently, the compaction module lacks integration tests. Impl these tests is crucial for ensuring the reliability and correctness of the compaction module.
Secondly, adding support for a manual compact operation in SQL would provide more flexibility to users, allowing them to trigger table compaction on demand.
### Proposal
The procedure to test the compaction module (in sql):
1. Create a table.
2. Insert data into table.
3. Flush in-memory data into sst.
4. Update data to simulate conditions requiring compaction.
5. Flush.
6. Trigger compaction. (manual compaction)
7. ~~Show compaction status.(optional)~~ (delete for easiness)
8. Verify the result.
The problem is that horaedb has not support manual compaction in sqlness yet. I want to impl `compact` as a pre-command, similar to `flush` command. The reason is:
+ **Consistency with existing command.** `flush` forces in-memory data to be written to SST files. Similarly, `compact` could be triggered to merge and optimize these SST files, aligning the two operations under the same command paradigm.
### Additional Context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For additional commands, e-mail: commits-help@horaedb.apache.org
Re: [I] Integration test for compaction offload [horaedb]
Posted by "Rachelint (via GitHub)" <gi...@apache.org>.
Rachelint closed issue #1571: Integration test for compaction offload
URL: https://github.com/apache/horaedb/issues/1571
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For additional commands, e-mail: commits-help@horaedb.apache.org
Re: [I] Integration test for compaction offload [horaedb]
Posted by "Rachelint (via GitHub)" <gi...@apache.org>.
Rachelint closed issue #1571: Integration test for compaction offload
URL: https://github.com/apache/horaedb/issues/1571
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@horaedb.apache.org
For additional commands, e-mail: commits-help@horaedb.apache.org