You are viewing a plain text version of this content. The canonical link for it is here.
Posted to oak-issues@jackrabbit.apache.org by "Michael Dürig (JIRA)" <ji...@apache.org> on 2015/12/07 14:35:11 UTC
[jira] [Comment Edited] (OAK-3613) Backport TarMK revision gc
related issues
[ https://issues.apache.org/jira/browse/OAK-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14998629#comment-14998629 ]
Michael Dürig edited comment on OAK-3613 at 12/7/15 1:34 PM:
-------------------------------------------------------------
OAK-2734: Compaction does not finish on repository with continuous writes ([1675311|http://svn.apache.org/r1675311])
OAK-2862: CompactionMap#compress() inefficient for large compaction maps ([1678958|http://svn.apache.org/r1678958], [1679959|http://svn.apache.org/r1679959], [1679995|http://svn.apache.org/r1679995], [1683780|http://svn.apache.org/r1683780])
OAK-2713: High memory usage of CompactionMap ([1679958|http://svn.apache.org/r1679958]) (1.0 only)
OAK-2849: Improve revision gc on SegmentMK ([1691216|http://svn.apache.org/r1691216], [1693194|http://svn.apache.org/r1693194])
OAK-3094: Potential ClassCastException with LIRS cache builder ([1690657|http://svn.apache.org/r1690657], [1690672|http://svn.apache.org/r1690672])
OAK-3095: Add eviction listener to LIRS cache ([1690991|http://svn.apache.org/r1690991])
OAK-3007: SegmentStore cache does not take "string" map into account ([1691217|http://svn.apache.org/r1691217], [1691218|http://svn.apache.org/r1691218])
OAK-3055: Improve segment cache in SegmentTracker ([1691219|http://svn.apache.org/r1691219], [1691220|http://svn.apache.org/r1691220])
OAK-3109: OOME in tarkmk standby tests ([1692272|http://svn.apache.org/r1692272], [1695829|http://svn.apache.org/r1695829], [1695830|http://svn.apache.org/r1695830])
OAK-3051: Improve compaction gain estimation logging for the case where there are no tar readers ([1691589|http://svn.apache.org/r1691589])
OAK-2384: SegmentNotFoundException when keeping JCR Value references ([1650503|http://svn.apache.org/r1650503], [1670137|http://svn.apache.org/r1670137]) (1.0 only)
OAK-3095: Add eviction listener to LIRS cache ([1692234|http://svn.apache.org/r1692234])
OAK-3055: Improve segment cache in SegmentTracker ([1692235|http://svn.apache.org/r1692235])
OAK-3139: SNFE in persisted comapation map when using CLEAN_OLD ([1693022|http://svn.apache.org/r1693022], [1693195|http://svn.apache.org/r1693195])
OAK-3168: SegmentCache flushes Segment on update ([1694022|http://svn.apache.org/r1694022])
OAK-3179: Deadlock between persisted compaction map and cleanup ([1694208|http://svn.apache.org/r1694208])
OAK-3177: Compaction slow on repository with continuous writes ([1694497|http://svn.apache.org/r1694497])
OAK-3264: Deadlock between persisted compaction map and cleanup 2 ( [1696956|http://svn.apache.org/r1696956])
OAK-2875: Namespaces keep references to old node states ([1697423|http://svn.apache.org/r1697423])
OAK-3317: ConcurrentModificationException when running SegmentOverflowExceptionIT ([1700252|http://svn.apache.org/r1700252])
OAK-3347: Ineffective cleanup after compaction due to references to root ([1701239|http://svn.apache.org/r1701239])
OAK-3329: TarMK cleanup blocks writers ([1706818|http://svn.apache.org/r1706818])
OAK-3481: CompationMapTest does not close file store ([1706974|http://svn.apache.org/r1706974])
OAK-3172: Unreleased closed sessions can keep a root reference from getting collected ([1707073|http://svn.apache.org/r1707073])
OAK-3502: Improve logging during cleanup ([1707753|http://svn.apache.org/r1707753])
OAK-3501: PersistedCompactionMap could release reference to records early ([1708051|http://svn.apache.org/r1708051])
OAK-3511: Test failure: CompactionMapTest.removeSome ([1708297|http://svn.apache.org/r1708297], [1708298|http://svn.apache.org/r1708298])
OAK-3330: FileStore lock contention with concurrent writers ([1708401|http://svn.apache.org/r1708401], [1708402|http://svn.apache.org/r1708402], [1708403|http://svn.apache.org/r1708403])
OAK-3506: Uniformization of compaction log messages ([1708447|http://svn.apache.org/r1708447], [1710629|http://svn.apache.org/r1710629])
OAK-2581: Metatype info for SegmentNodeStoreService ([1664942|http://svn.apache.org/r1664942]) (1.0 only)
OAK-2870: Introduce a SegmentNodeStoreBuilder to help wire a SegmentNodeStore ([1679998|http://svn.apache.org/r1679998])
OAK-3123: NPE in RecordIdMap ([1691965|http://svn.apache.org/r1691965])
OAK-1446: Offline tool to repair TarMK ([1586363|http://svn.apache.org/r1586363]) (1.0 only)
OAK-3158: IAE when specifiying 2G cache for FileStore ([1694639|http://svn.apache.org/r1694639], [1702240|http://svn.apache.org/r1702240])
OAK-2962: SegmentNodeStoreService fails to handle empty strings in the OSGi configuration ([1687171|http://svn.apache.org/r1687171])
OAK-3048: Enable lookup of OSGi configuration from framework first and component next ([1693868|http://svn.apache.org/r1693868])
OAK-3052: Make compaction gain estimate threshold configurable ([1689805|http://svn.apache.org/r1689805])
OAK-3125: Skip compaction estimation if threshold is 0 ([1692063|http://svn.apache.org/r1692063], [1692366|http://svn.apache.org/r1692366])
OAK-1995: Improved SegmentNodeStore documentation([1614816|http://svn.apache.org/r1614816], [1614817|http://svn.apache.org/r1614817], [1614818|http://svn.apache.org/r1614818], [1614819|http://svn.apache.org/r1614819], [1614820|http://svn.apache.org/r1614820], [1614856|http://svn.apache.org/r1614856], [1614867|http://svn.apache.org/r1614867])
OAK-3138: OOME in NodeStateCopierTest ([1692378|http://svn.apache.org/r1692378])
OAK-3682: added missing lucene-memory dependency to oak-lucene ([1716596|http://svn.apache.org/r1716596])
OAK-3705: Change default of compaction.forceAfterFail to false ([1717411|http://svn.apache.org/r1717411])
OAK-3732: Offline compaction doesn't clean up unreferenced tar files ([1718309|http://svn.apache.org/r1718309])
OAK-3737: Compactor should log revisions acting upon ([1718340|http://svn.apache.org/r1718340])
was (Author: mduerig):
OAK-2734: Compaction does not finish on repository with continuous writes ([1675311|http://svn.apache.org/r1675311])
OAK-2862: CompactionMap#compress() inefficient for large compaction maps ([1678958|http://svn.apache.org/r1678958], [1679959|http://svn.apache.org/r1679959], [1679995|http://svn.apache.org/r1679995], [1683780|http://svn.apache.org/r1683780])
OAK-2713: High memory usage of CompactionMap ([1679958|http://svn.apache.org/r1679958]) (1.0 only)
OAK-2849: Improve revision gc on SegmentMK ([1691216|http://svn.apache.org/r1691216], [1693194|http://svn.apache.org/r1693194])
OAK-3094: Potential ClassCastException with LIRS cache builder ([1690657|http://svn.apache.org/r1690657], [1690672|http://svn.apache.org/r1690672])
OAK-3095: Add eviction listener to LIRS cache ([1690991|http://svn.apache.org/r1690991])
OAK-3007: SegmentStore cache does not take "string" map into account ([1691217|http://svn.apache.org/r1691217], [1691218|http://svn.apache.org/r1691218])
OAK-3055: Improve segment cache in SegmentTracker ([1691219|http://svn.apache.org/r1691219], [1691220|http://svn.apache.org/r1691220])
OAK-3109: OOME in tarkmk standby tests ([1692272|http://svn.apache.org/r1692272], [1695829|http://svn.apache.org/r1695829], [1695830|http://svn.apache.org/r1695830])
OAK-3051: Improve compaction gain estimation logging for the case where there are no tar readers ([1691589|http://svn.apache.org/r1691589])
OAK-2384: SegmentNotFoundException when keeping JCR Value references ([1650503|http://svn.apache.org/r1650503], [1670137|http://svn.apache.org/r1670137]) (1.0 only)
OAK-3095: Add eviction listener to LIRS cache ([1692234|http://svn.apache.org/r1692234])
OAK-3055: Improve segment cache in SegmentTracker ([1692235|http://svn.apache.org/r1692235])
OAK-3139: SNFE in persisted comapation map when using CLEAN_OLD ([1693022|http://svn.apache.org/r1693022], [1693195|http://svn.apache.org/r1693195])
OAK-3168: SegmentCache flushes Segment on update ([1694022|http://svn.apache.org/r1694022])
OAK-3179: Deadlock between persisted compaction map and cleanup ([1694208|http://svn.apache.org/r1694208])
OAK-3177: Compaction slow on repository with continuous writes ([1694497|http://svn.apache.org/r1694497])
OAK-3264: Deadlock between persisted compaction map and cleanup 2 ( [1696956|http://svn.apache.org/r1696956])
OAK-2875: Namespaces keep references to old node states ([1697423|http://svn.apache.org/r1697423])
OAK-3317: ConcurrentModificationException when running SegmentOverflowExceptionIT ([1700252|http://svn.apache.org/r1700252])
OAK-3347: Ineffective cleanup after compaction due to references to root ([1701239|http://svn.apache.org/r1701239])
OAK-3329: TarMK cleanup blocks writers ([1706818|http://svn.apache.org/r1706818])
OAK-3481: CompationMapTest does not close file store ([1706974|http://svn.apache.org/r1706974])
OAK-3172: Unreleased closed sessions can keep a root reference from getting collected ([1707073|http://svn.apache.org/r1707073])
OAK-3502: Improve logging during cleanup ([1707753|http://svn.apache.org/r1707753])
OAK-3501: PersistedCompactionMap could release reference to records early ([1708051|http://svn.apache.org/r1708051])
OAK-3511: Test failure: CompactionMapTest.removeSome ([1708297|http://svn.apache.org/r1708297], [1708298|http://svn.apache.org/r1708298])
OAK-3330: FileStore lock contention with concurrent writers ([1708401|http://svn.apache.org/r1708401], [1708402|http://svn.apache.org/r1708402], [1708403|http://svn.apache.org/r1708403])
OAK-3506: Uniformization of compaction log messages ([1708447|http://svn.apache.org/r1708447], [1710629|http://svn.apache.org/r1710629])
OAK-2581: Metatype info for SegmentNodeStoreService ([1664942|http://svn.apache.org/r1664942]) (1.0 only)
OAK-2870: Introduce a SegmentNodeStoreBuilder to help wire a SegmentNodeStore ([1679998|http://svn.apache.org/r1679998])
OAK-3123: NPE in RecordIdMap ([1691965|http://svn.apache.org/r1691965])
OAK-1446: Offline tool to repair TarMK ([1586363|http://svn.apache.org/r1586363]) (1.0 only)
OAK-3158: IAE when specifiying 2G cache for FileStore ([1694639|http://svn.apache.org/r1694639], [1702240|http://svn.apache.org/r1702240])
OAK-2962: SegmentNodeStoreService fails to handle empty strings in the OSGi configuration ([1687171|http://svn.apache.org/r1687171])
OAK-3048: Enable lookup of OSGi configuration from framework first and component next ([1693868|http://svn.apache.org/r1693868])
OAK-3052: Make compaction gain estimate threshold configurable ([1689805|http://svn.apache.org/r1689805])
OAK-3125: Skip compaction estimation if threshold is 0 ([1692063|http://svn.apache.org/r1692063], [1692366|http://svn.apache.org/r1692366])
OAK-1995: Improved SegmentNodeStore documentation([1614816|http://svn.apache.org/r1614816], [1614817|http://svn.apache.org/r1614817], [1614818|http://svn.apache.org/r1614818], [1614819|http://svn.apache.org/r1614819], [1614820|http://svn.apache.org/r1614820], [1614856|http://svn.apache.org/r1614856], [1614867|http://svn.apache.org/r1614867])
OAK-3138: OOME in NodeStateCopierTest ([1692378|http://svn.apache.org/r1692378])
> Backport TarMK revision gc related issues
> -----------------------------------------
>
> Key: OAK-3613
> URL: https://issues.apache.org/jira/browse/OAK-3613
> Project: Jackrabbit Oak
> Issue Type: Task
> Components: segmentmk
> Reporter: Michael Dürig
> Assignee: Michael Dürig
> Labels: compaction, gc
> Fix For: 1.2.9, 1.0.25
>
> Attachments: 0001-OAK-2870-Introduce-a-SegmentNodeStoreBuilder-to-help.patch, 1.2-OAK-2870.patch, OAK-1995-1.0.patch, OAK-1995-1.2.zip, OsgiUtil-1.0.patch, OsgiUtil-1.2.patch
>
>
> Some of the issues related to TarMK revision gc should be back ported to the branches. This issue is for keeping track of which issues and which svn revisions we consider for back porting. The task consists of the following steps:
> # Identify issue to back port
> # Merge the respective commits into a private forks of the 1.0 and 1.2 branches
> # Run tests on builds from the private forks
> # On success merge the private forks to the 1.0 and 1.2 branches and update the fix versions of the respective issues.
> * Update the svn merge info with the respective merged svn revisions.
> * Update the fix versions of the affected issues.
> [~dhasler]: FYI
> [~alex.parvulescu], [~frm]: please refrain from merging potential conflicting changes into the branches in the meanwhile.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)