You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kudu.apache.org by "Andrew Wong (JIRA)" <ji...@apache.org> on 2017/03/10 23:10:04 UTC

[jira] [Comment Edited] (KUDU-1736) kudu crash in debug build: unordered undo delta

    [ https://issues.apache.org/jira/browse/KUDU-1736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15905847#comment-15905847 ] 

Andrew Wong edited comment on KUDU-1736 at 3/10/17 11:09 PM:
-------------------------------------------------------------

Also saw this on Jenkins:
{code}
delta_tracker.cc:208] Check failed: first_copy->delta_stats().min_timestamp() >= second_copy->delta_stats().min_timestamp() (5678 vs. 5681) Found out-of-order deltas: [{11440216355432745334 (ts range=[5678, 5775], delete_count=[0], reinsert_count=[0], update_counts_by_col_id=[12:3))}, {11440216355432745315 (ts range=[5681, 5761], delete_count=[0], reinsert_count=[0], update_counts_by_col_id=[12:18))}]: type = 1
    @     0x7f4f0ef11c37 gsignal at ??:0
    @     0x7f4f0ef15028 abort at ??:0
    @     0x7f4f1bc02ae4 kudu::tablet::DeltaTracker::ValidateDeltaOrder() at ??:0
    @     0x7f4f1bc031c5 kudu::tablet::DeltaTracker::AtomicUpdateStores() at ??:0
    @     0x7f4f1bbe8304 kudu::tablet::MajorDeltaCompaction::UpdateDeltaTracker() at ??:0
    @     0x7f4f1baf7e35 kudu::tablet::DiskRowSet::MajorCompactDeltaStoresWithColumnIds() at ??:0
    @     0x7f4f1baf7811 kudu::tablet::DiskRowSet::MajorCompactDeltaStores() at ??:0
    @     0x7f4f1b9d7687 kudu::tablet::Tablet::CompactWorstDeltas() at ??:0
    @           0x5e5cbc kudu::tablet::MultiThreadedTabletTest<>::CompactDeltas() at /home/jenkins-slave/workspace/kudu-master/2/src/kudu/tablet/mt-tablet-test.cc:307 (discriminator 17)
    @           0x5e48e8 boost::_bi::bind_t<>::operator()() at /home/jenkins-slave/workspace/kudu-master/2/thirdparty/installed/common/include/boost/bind/bind.hpp:1223
    @     0x7f4f143a5d3f boost::function0<>::operator()() at ??:0
    @     0x7f4f121565e4 kudu::Thread::SuperviseThread() at ??:0
    @     0x7f4f17da4184 start_thread at ??:0
    @     0x7f4f0efd537d clone at ??:0
{code}

Failure log can be found here: http://104.196.14.100/job/kudu-gerrit/6963/BUILD_TYPE=ASAN/


was (Author: andrew.wong):
Also saw this on Jenkins:
```
delta_tracker.cc:208] Check failed: first_copy->delta_stats().min_timestamp() >= second_copy->delta_stats().min_timestamp() (5678 vs. 5681) Found out-of-order deltas: [{11440216355432745334 (ts range=[5678, 5775], delete_count=[0], reinsert_count=[0], update_counts_by_col_id=[12:3))}, {11440216355432745315 (ts range=[5681, 5761], delete_count=[0], reinsert_count=[0], update_counts_by_col_id=[12:18))}]: type = 1
    @     0x7f4f0ef11c37 gsignal at ??:0
    @     0x7f4f0ef15028 abort at ??:0
    @     0x7f4f1bc02ae4 kudu::tablet::DeltaTracker::ValidateDeltaOrder() at ??:0
    @     0x7f4f1bc031c5 kudu::tablet::DeltaTracker::AtomicUpdateStores() at ??:0
    @     0x7f4f1bbe8304 kudu::tablet::MajorDeltaCompaction::UpdateDeltaTracker() at ??:0
    @     0x7f4f1baf7e35 kudu::tablet::DiskRowSet::MajorCompactDeltaStoresWithColumnIds() at ??:0
    @     0x7f4f1baf7811 kudu::tablet::DiskRowSet::MajorCompactDeltaStores() at ??:0
    @     0x7f4f1b9d7687 kudu::tablet::Tablet::CompactWorstDeltas() at ??:0
    @           0x5e5cbc kudu::tablet::MultiThreadedTabletTest<>::CompactDeltas() at /home/jenkins-slave/workspace/kudu-master/2/src/kudu/tablet/mt-tablet-test.cc:307 (discriminator 17)
    @           0x5e48e8 boost::_bi::bind_t<>::operator()() at /home/jenkins-slave/workspace/kudu-master/2/thirdparty/installed/common/include/boost/bind/bind.hpp:1223
    @     0x7f4f143a5d3f boost::function0<>::operator()() at ??:0
    @     0x7f4f121565e4 kudu::Thread::SuperviseThread() at ??:0
    @     0x7f4f17da4184 start_thread at ??:0
    @     0x7f4f0efd537d clone at ??:0
```

Failure log can be found here: http://104.196.14.100/job/kudu-gerrit/6963/BUILD_TYPE=ASAN/

> kudu crash in debug build: unordered undo delta
> -----------------------------------------------
>
>                 Key: KUDU-1736
>                 URL: https://issues.apache.org/jira/browse/KUDU-1736
>             Project: Kudu
>          Issue Type: Bug
>          Components: tablet
>            Reporter: zhangsong
>            Priority: Critical
>         Attachments: mt-tablet-test.txt.gz
>
>
> in jd cluster we met kudu-tserver crash with fatal messages described as follow:
> Check failed: last_key_.CompareTo<UNDO>(key) <= 0 must insert undo deltas in sorted order (ascending key, then descending ts): got key (row 1422@tx6052042821982183424) after (row 1422@tx6052042821953155072)
> This is a dcheck which should not failed.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)