You are viewing a plain text version of this content. The canonical link for it is here.
Posted to oak-issues@jackrabbit.apache.org by "Alex Parvulescu (JIRA)" <ji...@apache.org> on 2016/06/24 11:52:16 UTC
[jira] [Comment Edited] (OAK-4505) Offline compaction clearer
output values
[ https://issues.apache.org/jira/browse/OAK-4505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15348174#comment-15348174 ]
Alex Parvulescu edited comment on OAK-4505 at 6/24/16 11:52 AM:
----------------------------------------------------------------
Sample successful output:
{noformat}
Compacting /Users/aparvule/ci/oak/cq/crx-quickstart/repository/segmentstore
before
Mon May 30 16:14:26 CEST 2016, data00000i.tar
Mon May 30 16:14:26 CEST 2016, data00001i.tar
Mon May 30 16:14:25 CEST 2016, data00002i.tar
Mon May 30 16:14:25 CEST 2016, data00003j.tar
Mon May 30 16:14:25 CEST 2016, data00004j.tar
Fri Jun 24 11:38:50 CEST 2016, data00068a.tar
Fri Jun 24 11:38:51 CEST 2016, journal.log
Mon May 30 14:51:49 CEST 2016, repo.lock
size 1,1 GB (1072491583 bytes)
-> compacting
-> cleaning up
-> removed old file data00068a.tar
-> writing new journal.log: da27750c-2c71-4636-a013-efd8053f820d:232652 root 1466761575153
after
Mon May 30 16:14:26 CEST 2016, data00000i.tar
Mon May 30 16:14:26 CEST 2016, data00001i.tar
Mon May 30 16:14:25 CEST 2016, data00002i.tar
Mon May 30 16:14:25 CEST 2016, data00003j.tar
Mon May 30 16:14:25 CEST 2016, data00004j.tar
Fri Jun 24 11:46:14 CEST 2016, data00069a.tar
Fri Jun 24 11:46:15 CEST 2016, journal.log
Mon May 30 14:51:49 CEST 2016, repo.lock
size 1,1 GB (1072491583 bytes)
removed files [data00068a.tar]
added files [data00069a.tar]
Compaction succeeded in 10,26 s (10s).
{noformat}
Sample failure output:
{noformat}
Compacting .
before
Mon May 30 16:14:26 CEST 2016, data00000i.tar
Mon May 30 16:14:26 CEST 2016, data00001i.tar
Mon May 30 16:14:25 CEST 2016, data00002i.tar
Mon May 30 16:14:25 CEST 2016, data00003j.tar
Mon May 30 16:14:25 CEST 2016, data00004j.tar
Fri Jun 24 11:46:14 CEST 2016, data00069a.tar
Fri Jun 24 11:46:15 CEST 2016, journal.log
Mon May 30 14:51:49 CEST 2016, repo.lock
size 1,1 GB (1072491583 bytes)
-> compacting
Compaction failure stack trace:
java.lang.OutOfMemoryError: Java heap space
at org.apache.jackrabbit.oak.cache.CacheLIRS$Segment.clear(CacheLIRS.java:829)
at org.apache.jackrabbit.oak.cache.CacheLIRS$Segment.<init>(CacheLIRS.java:784)
at org.apache.jackrabbit.oak.cache.CacheLIRS.invalidateAll(CacheLIRS.java:196)
at org.apache.jackrabbit.oak.cache.CacheLIRS.<init>(CacheLIRS.java:183)
at org.apache.jackrabbit.oak.cache.CacheLIRS$Builder.build(CacheLIRS.java:1571)
at org.apache.jackrabbit.oak.cache.CacheLIRS$Builder.build(CacheLIRS.java:1567)
at org.apache.jackrabbit.oak.plugins.segment.StringCache.<init>(StringCache.java:55)
at org.apache.jackrabbit.oak.plugins.segment.SegmentTracker.<init>(SegmentTracker.java:140)
at org.apache.jackrabbit.oak.plugins.segment.file.FileStore.<init>(FileStore.java:394)
at org.apache.jackrabbit.oak.plugins.segment.file.FileStore.<init>(FileStore.java:91)
at org.apache.jackrabbit.oak.plugins.segment.file.FileStore$ReadOnlyStore.<init>(FileStore.java:1398)
at org.apache.jackrabbit.oak.plugins.segment.file.FileStore$ReadOnlyStore.<init>(FileStore.java:1395)
at org.apache.jackrabbit.oak.plugins.segment.file.FileStore$Builder.buildReadOnly(FileStore.java:376)
at org.apache.jackrabbit.oak.plugins.segment.FileStoreHelper.openReadOnlyFileStore(FileStoreHelper.java:223)
at org.apache.jackrabbit.oak.plugins.segment.FileStoreHelper.checkFileStoreVersionOrFail(FileStoreHelper.java:181)
at org.apache.jackrabbit.oak.plugins.segment.FileStoreHelper.openFileStore(FileStoreHelper.java:208)
at org.apache.jackrabbit.oak.run.SegmentUtils.compact(SegmentUtils.java:169)
at org.apache.jackrabbit.oak.run.CompactCommand.execute(CompactCommand.java:76)
at org.apache.jackrabbit.oak.run.Mode.execute(Mode.java:63)
at org.apache.jackrabbit.oak.run.Main.main(Main.java:49)
Compaction failed in 281,8 ms (0s).
{noformat}
In case of failure the process return value will be {{1}}, signaling an error.
was (Author: alex.parvulescu):
Sample successful output:
{noformat}
Compacting /Users/aparvule/ci/oak/cq/crx-quickstart/repository/segmentstore
before
Mon May 30 16:14:26 CEST 2016, data00000i.tar
Mon May 30 16:14:26 CEST 2016, data00001i.tar
Mon May 30 16:14:25 CEST 2016, data00002i.tar
Mon May 30 16:14:25 CEST 2016, data00003j.tar
Mon May 30 16:14:25 CEST 2016, data00004j.tar
Fri Jun 24 11:38:50 CEST 2016, data00068a.tar
Fri Jun 24 11:38:51 CEST 2016, journal.log
Mon May 30 14:51:49 CEST 2016, repo.lock
size 1,1 GB (1072491583 bytes)
-> compacting
-> cleaning up
-> removed old file data00068a.tar
-> writing new journal.log: da27750c-2c71-4636-a013-efd8053f820d:232652 root 1466761575153
after
Mon May 30 16:14:26 CEST 2016, data00000i.tar
Mon May 30 16:14:26 CEST 2016, data00001i.tar
Mon May 30 16:14:25 CEST 2016, data00002i.tar
Mon May 30 16:14:25 CEST 2016, data00003j.tar
Mon May 30 16:14:25 CEST 2016, data00004j.tar
Fri Jun 24 11:46:14 CEST 2016, data00069a.tar
Fri Jun 24 11:46:15 CEST 2016, journal.log
Mon May 30 14:51:49 CEST 2016, repo.lock
size 1,1 GB (1072491583 bytes)
removed files [data00068a.tar]
added files [data00069a.tar]
Compaction succeeded in 10,26 s (10s).
{noformat}
Sample failure output:
{noformat}
Compacting .
before
Mon May 30 16:14:26 CEST 2016, data00000i.tar
Mon May 30 16:14:26 CEST 2016, data00001i.tar
Mon May 30 16:14:25 CEST 2016, data00002i.tar
Mon May 30 16:14:25 CEST 2016, data00003j.tar
Mon May 30 16:14:25 CEST 2016, data00004j.tar
Fri Jun 24 11:46:14 CEST 2016, data00069a.tar
Fri Jun 24 11:46:15 CEST 2016, journal.log
Mon May 30 14:51:49 CEST 2016, repo.lock
size 1,1 GB (1072491583 bytes)
-> compacting
Compaction failure stack trace:
java.lang.OutOfMemoryError: Java heap space
at org.apache.jackrabbit.oak.cache.CacheLIRS$Segment.clear(CacheLIRS.java:829)
at org.apache.jackrabbit.oak.cache.CacheLIRS$Segment.<init>(CacheLIRS.java:784)
at org.apache.jackrabbit.oak.cache.CacheLIRS.invalidateAll(CacheLIRS.java:196)
at org.apache.jackrabbit.oak.cache.CacheLIRS.<init>(CacheLIRS.java:183)
at org.apache.jackrabbit.oak.cache.CacheLIRS$Builder.build(CacheLIRS.java:1571)
at org.apache.jackrabbit.oak.cache.CacheLIRS$Builder.build(CacheLIRS.java:1567)
at org.apache.jackrabbit.oak.plugins.segment.StringCache.<init>(StringCache.java:55)
at org.apache.jackrabbit.oak.plugins.segment.SegmentTracker.<init>(SegmentTracker.java:140)
at org.apache.jackrabbit.oak.plugins.segment.file.FileStore.<init>(FileStore.java:394)
at org.apache.jackrabbit.oak.plugins.segment.file.FileStore.<init>(FileStore.java:91)
at org.apache.jackrabbit.oak.plugins.segment.file.FileStore$ReadOnlyStore.<init>(FileStore.java:1398)
at org.apache.jackrabbit.oak.plugins.segment.file.FileStore$ReadOnlyStore.<init>(FileStore.java:1395)
at org.apache.jackrabbit.oak.plugins.segment.file.FileStore$Builder.buildReadOnly(FileStore.java:376)
at org.apache.jackrabbit.oak.plugins.segment.FileStoreHelper.openReadOnlyFileStore(FileStoreHelper.java:223)
at org.apache.jackrabbit.oak.plugins.segment.FileStoreHelper.checkFileStoreVersionOrFail(FileStoreHelper.java:181)
at org.apache.jackrabbit.oak.plugins.segment.FileStoreHelper.openFileStore(FileStoreHelper.java:208)
at org.apache.jackrabbit.oak.run.SegmentUtils.compact(SegmentUtils.java:169)
at org.apache.jackrabbit.oak.run.CompactCommand.execute(CompactCommand.java:76)
at org.apache.jackrabbit.oak.run.Mode.execute(Mode.java:63)
at org.apache.jackrabbit.oak.run.Main.main(Main.java:49)
Compaction failed in 281,8 ms (0s).
{noformat}
> Offline compaction clearer output values
> ----------------------------------------
>
> Key: OAK-4505
> URL: https://issues.apache.org/jira/browse/OAK-4505
> Project: Jackrabbit Oak
> Issue Type: Improvement
> Components: segment-tar, segmentmk
> Reporter: Alex Parvulescu
> Assignee: Alex Parvulescu
> Fix For: 1.6
>
>
> I'd like to have offline compaction return a failure code in case of any error happening during the process (like an OOME). this would help greatly with scripting efforts for automated maintenance operations.
> Other ideas worth pursuing:
> * a one line status at the end of the process: "Compaction succeeded in XXX min" or "Compaction failed in XXX mins".
> * a better directory listing pre and post compaction (sorted list, and possibly including the last modified date).
> * bonus points for delta output (tar files removed, tar files added).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)