You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by "Yaqian Zhang (Jira)" <ji...@apache.org> on 2022/01/06 06:53:00 UTC

[jira] [Closed] (KYLIN-4964) Receiver consumer thread should be stoped while encounting unrecoverable error

     [ https://issues.apache.org/jira/browse/KYLIN-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yaqian Zhang closed KYLIN-4964.
-------------------------------

Resolved in release 3.1.3 (2022-01-06)

> Receiver consumer thread should be stoped while encounting unrecoverable error
> ------------------------------------------------------------------------------
>
>                 Key: KYLIN-4964
>                 URL: https://issues.apache.org/jira/browse/KYLIN-4964
>             Project: Kylin
>          Issue Type: Bug
>          Components: Real-time Streaming
>    Affects Versions: v3.1.1
>            Reporter: Xingxing Di
>            Assignee: Xingxing Di
>            Priority: Major
>             Fix For: v3.1.3
>
>
> org.apache.kylin.stream.core.storage.columnar.ColumnarMemoryStorePersister#persist will catch exception and just log it, this behavior will cause critical problem, like our case: there is no space left on device, `persist` method failed for many times, we lost several hours of data.
> Here is our solution which already tested:
>  # Throw IllegalStorageException while we cannot do the persist
>  # Then stop the consumer thread
>  # Add `consumer_thread_alive` in ConsumerStats for monitoring
>  # Also fix an another issue which will cause wrong result after restore from checkpoint
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)