[jira] [Created] (IGNITE-17456) After node restart, there are duplicate messages about WAL segment compression.

["Pavel Pereslegin (Jira)" <ji...@apache.org>]

Pavel Pereslegin created IGNITE-17456:
-----------------------------------------

             Summary: After node restart, there are duplicate messages about WAL segment compression.
                 Key: IGNITE-17456
                 URL: https://issues.apache.org/jira/browse/IGNITE-17456
             Project: Ignite
          Issue Type: Bug
            Reporter: Pavel Pereslegin
            Assignee: Pavel Pereslegin


If you enable compression of WAL segments and at the same time set the WAL archive size too small, then compression will not actually occur, but after each node restart, "fake" notifications about segment compression are sequentially written to the log from the beginning (see log example below).

{noformat}
[2022-08-02T14:46:33,757][INFO ][test-runner-#1%wal.WalCompactionAfterRestartTest%][FileWriteAheadLogManager] Resolved write ahead log work directory: /home/xtern/src/java/ignite/work/db/wal/node00-63fb6fa2-fcea-42aa-a3c8-b36cd330ba7c
[2022-08-02T14:46:33,757][INFO ][test-runner-#1%wal.WalCompactionAfterRestartTest%][FileWriteAheadLogManager] Resolved write ahead log archive directory: /home/xtern/src/java/ignite/work/db/wal/archive/node00-63fb6fa2-fcea-42aa-a3c8-b36cd330ba7c
[2022-08-02T14:46:33,759][INFO ][test-runner-#1%wal.WalCompactionAfterRestartTest%][FileWriteAheadLogManager] Enqueuing segment for compression [idx=0]
[2022-08-02T14:46:33,759][INFO ][test-runner-#1%wal.WalCompactionAfterRestartTest%][FileWriteAheadLogManager] Enqueuing segment for compression [idx=1]
[2022-08-02T14:46:33,759][INFO ][test-runner-#1%wal.WalCompactionAfterRestartTest%][FileWriteAheadLogManager] Enqueuing segment for compression [idx=2]
[2022-08-02T14:46:33,759][INFO ][test-runner-#1%wal.WalCompactionAfterRestartTest%][FileWriteAheadLogManager] Enqueuing segment for compression [idx=3]
...
[2022-08-02T14:46:33,761][INFO ][test-runner-#1%wal.WalCompactionAfterRestartTest%][FileWriteAheadLogManager] Enqueuing segment for compression [idx=49]
[2022-08-02T14:46:33,761][INFO ][test-runner-#1%wal.WalCompactionAfterRestartTest%][FileHandleManagerImpl] Initialized write-ahead log manager [mode=LOG_ONLY]
...
[2022-08-02T14:46:34,084][INFO ][wal-file-compressor-%wal.WalCompactionAfterRestartTest0%-1-#133%wal.WalCompactionAfterRestartTest0%][FileWriteAheadLogManager] Segment compressed notification [idx=0]
[2022-08-02T14:46:34,084][INFO ][wal-file-compressor-%wal.WalCompactionAfterRestartTest0%-0-#131%wal.WalCompactionAfterRestartTest0%][FileWriteAheadLogManager] Segment compressed notification [idx=1]
[2022-08-02T14:46:34,084][INFO ][wal-file-compressor-%wal.WalCompactionAfterRestartTest0%-0-#131%wal.WalCompactionAfterRestartTest0%][FileWriteAheadLogManager] Segment compressed notification [idx=2]
[2022-08-02T14:46:34,084][INFO ][wal-file-compressor-%wal.WalCompactionAfterRestartTest0%-0-#131%wal.WalCompactionAfterRestartTest0%][FileWriteAheadLogManager] Segment compressed notification [idx=3]
...
[2022-08-02T14:46:34,092][INFO ][wal-file-compressor-%wal.WalCompactionAfterRestartTest0%-0-#131%wal.WalCompactionAfterRestartTest0%][FileWriteAheadLogManager] Segment compressed notification [idx=49]
[2022-08-02T14:46:34,093][INFO ][exchange-worker-#127%wal.WalCompactionAfterRestartTest0%][GridCacheProcessor] Finished recovery for cache [cache=ignite-sys-cache, grp=ignite-sys-cache, startVer=AffinityTopologyVersion [topVer=1, minorTopVer=1]]
{noformat}

Reproducer:

{code:java}
    private final ListeningTestLogger logger = new ListeningTestLogger(log);

    /** {@inheritDoc} */
    @Override protected IgniteConfiguration getConfiguration(String name) throws Exception {
        IgniteConfiguration cfg = super.getConfiguration(name);

        cfg.setGridLogger(logger)
            .setDataStorageConfiguration(new DataStorageConfiguration()
                .setDefaultDataRegionConfiguration(new DataRegionConfiguration()
                    .setPersistenceEnabled(true))
                .setWalSegmentSize(512 * 1024)
                .setMaxWalArchiveSize(512 * 1024)
                .setWalCompactionEnabled(true)
            );

        return cfg;
    }

    @Test
    public void testCompactionDuplicationNotificationsOnRestart() throws Exception {
        String msg = "Segment compressed notification [idx=0]";
        LogListener exactOnceMsg = LogListener.matches(msg).times(1).build();
        LogListener duplicationMsgCheck = LogListener.matches(msg).times(0).build();

        logger.registerListener(exactOnceMsg);

        IgniteEx ignite = startGrid(0);

        ignite.cluster().state(ClusterState.ACTIVE);

        for (int i = 0; i < 1_000; i++)
            ignite.getOrCreateCache(DEFAULT_CACHE_NAME).put(i, i);

        assertTrue(ignite.context().cache().context().wal().lastCompactedSegment() > 0);
        assertTrue(exactOnceMsg.check());

        // Restart grid.
        stopGrid(0);

        logger.registerListener(duplicationMsgCheck);

        ignite = startGrid(0);

        ignite.cluster().state(ClusterState.ACTIVE);

        assertTrue("Duplicate notification present after restart.", duplicationMsgCheck.check());
    }
{code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)