You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@asterixdb.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2019/01/10 23:59:00 UTC
[jira] [Commented] (ASTERIXDB-2506) Periodically Flush Idle
Datasets
[ https://issues.apache.org/jira/browse/ASTERIXDB-2506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16739886#comment-16739886 ]
ASF subversion and git services commented on ASTERIXDB-2506:
------------------------------------------------------------
Commit ff016514cca70c50085f07cb19400dd70e8ff01f in asterixdb's branch refs/heads/master from Murtadha Makki Al Hubail
[ https://git-wip-us.apache.org/repos/asf?p=asterixdb.git;h=ff01651 ]
[ASTERIXDB-2506][STO] Checkpoint Datasets
- user model changes: no
- storage format changes: no
- interface changes: yes
Details:
- Add new config to specify dataset checkpoint interval
and default its value to 10 minutes.
- Flush datasets which were not flushed for the dataset
checkpoint interval.
- Run dataset checkpoint logic as part of the CheckpointThread.
- Improve dataset async flush API to accept any LSM index predicate.
- Cleanup exception handling in CheckpoinThread.
- Add test case for dataset checkpoint.
Change-Id: I38a73a43a4b1b7d3a8ac79dd579ed4ef8c9c6a9b
Reviewed-on: https://asterix-gerrit.ics.uci.edu/3106
Sonar-Qube: Jenkins <je...@fulliautomatix.ics.uci.edu>
Tested-by: Jenkins <je...@fulliautomatix.ics.uci.edu>
Integration-Tests: Jenkins <je...@fulliautomatix.ics.uci.edu>
Contrib: Jenkins <je...@fulliautomatix.ics.uci.edu>
Reviewed-by: Till Westmann <ti...@apache.org>
> Periodically Flush Idle Datasets
> --------------------------------
>
> Key: ASTERIXDB-2506
> URL: https://issues.apache.org/jira/browse/ASTERIXDB-2506
> Project: Apache AsterixDB
> Issue Type: Improvement
> Components: STO - Storage
> Affects Versions: 0.9.5
> Reporter: Murtadha Hubail
> Assignee: Murtadha Hubail
> Priority: Major
> Fix For: 0.9.5
>
>
> We should periodically flush datasets that have some data in their in-memory component and haven't been flushed for some amount of time. This will avoid the need to redo the lost in-memory operations during recovery in case of any failure or ungraceful shutdown.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)