You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@doris.apache.org by 22...@winnermedical.com on 2023/02/13 05:57:52 UTC
答复: 【请注意这是一封外部邮件】Re:doris be宕机
版本是doris-1.2.1-rc01
________________________________________
发件人: Mingyu Chen <mo...@163.com>
发送时间: 2023年2月13日 13:43
收件人: dev@doris.apache.org
主题: 【请注意这是一封外部邮件】Re:doris be宕机
What is your Doris version?
--
此致！Best Regards
陈明雨 Mingyu Chen
Email:
morningman@apache.org
At 2023-02-13 09:35:50, "" <22...@winnermedical.com> wrote:
>
>您好！
> 我这边在使用broker load进行导入到doris时，一直存在会把be节点搞宕机，一直没有定位到关键问题。还请帮忙看一下问题
>问题报错：be.out文件内容
>terminate called after throwing an instance of 'orc::ParseError'
> what(): Failed to read hdfs://DATALAKE/warehouse/tablespace/managed/hive/test_winner_grp.db/ads_mpc_goods_sale_rt_pt_d_incr/part-00126-36dd66ba-a6a2-4625-ac38-0fc6cb2228c2-c000: Internal error: Read from broker failed, broker:TNetworkAddress(hostname=10.49.146.24, port=8000) failed:errors while write data to output stream, cause by: Filesystem closed
>*** Query id: 4360764793334480-9a89563a04dfc99b ***
>*** Aborted at 1676191418 (unix time) try "date -d @1676191418" if you are using GNU date ***
>*** Current BE git commitID: Unknown ***
>*** SIGABRT unkown detail explain (@0x1db2) received by PID 7602 (TID 0x7f28a59f9700) from PID 7602; stack trace: ***
> 0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) at /root/doris/be/src/common/signal_handler.h:420
> 1# 0x00007F291215F3B0 in /lib64/libc.so.6
> 2# gsignal in /lib64/libc.so.6
> 3# __GI_abort in /lib64/libc.so.6
> 4# __gnu_cxx::__verbose_terminate_handler() [clone .cold] in /data/doris-1.2.1/be/lib/doris_be
> 5# __cxxabiv1::__terminate(void (*)()) in /data/doris-1.2.1/be/lib/doris_be
> 6# 0x0000564F1207B7C1 in /data/doris-1.2.1/be/lib/doris_be
> 7# 0x0000564F1207B915 in /data/doris-1.2.1/be/lib/doris_be
> 8# doris::vectorized::ORCFileInputStream::read(void*, unsigned long, unsigned long) [clone .cold] at /root/doris/be/src/vec/exec/format/orc/vorc_reader.cpp:67
> 9# orc::SeekableFileInputStream::Next(void const**, int*) in /data/doris-1.2.1/be/lib/doris_be
>10# orc::DecompressionStream::readBuffer(bool) in /data/doris-1.2.1/be/lib/doris_be
>11# orc::DecompressionStream::readHeader() in /data/doris-1.2.1/be/lib/doris_be
>12# orc::DecompressionStream::Next(void const**, int*) in /data/doris-1.2.1/be/lib/doris_be
>13# orc::RleDecoderV2::next(long*, unsigned long, char const*) in /data/doris-1.2.1/be/lib/doris_be
>14# orc::StringDictionaryColumnReader::next(orc::ColumnVectorBatch&, unsigned long, char*) in /data/doris-1.2.1/be/lib/doris_be
>15# orc::StructColumnReader::next(orc::ColumnVectorBatch&, unsigned long, char*) in /data/doris-1.2.1/be/lib/doris_be
>16# orc::RowReaderImpl::next(orc::ColumnVectorBatch&) in /data/doris-1.2.1/be/lib/doris_be
>17# doris::vectorized::OrcReader::get_next_block(doris::vectorized::Block*, unsigned long*, bool*) at /root/doris/be/src/vec/exec/format/orc/vorc_reader.cpp:747
>18# doris::vectorized::VFileScanner::_get_block_impl(doris::RuntimeState*, doris::vectorized::Block*, bool*) at /root/doris/be/src/vec/exec/scan/vfile_scanner.cpp:148
>19# doris::vectorized::VScanner::get_block(doris::RuntimeState*, doris::vectorized::Block*, bool*) at /root/doris/be/src/vec/exec/scan/vscanner.cpp:53
>20# doris::vectorized::ScannerScheduler::_scanner_scan(doris::vectorized::ScannerScheduler*, doris::vectorized::ScannerContext*, doris::vectorized::VScanner*) at /root/doris/be/src/vec/exec/scan/scanner_scheduler.cpp:234
>21# doris::ThreadPool::dispatch_thread() at /root/doris/be/src/util/threadpool.cpp:542
>22# doris::Thread::supervise_thread(void*) at /root/doris/be/src/util/thread.cpp:455
>23# start_thread in /lib64/libpthread.so.0
>24# clone in /lib64/libc.so.6
>
>be.warn文件内容：
>W0212 16:43:38.025727 7742 broker_reader.cpp:186] Read from broker failed, broker:TNetworkAddress(hostname=10.49.146.24, port=8000) failed:errors while write data to output stream, cause by: Filesystem closed
>W0212 16:43:50.535388 21144 cumulative_compaction.cpp:112] There are missed versions among rowsets. prev rowset verison=[34235-34235], next rowset version=[34237-34237], tablet=1020778.276917532.244d8cd50094d83d-2beda143c376479f
>W0212 16:43:50.837388 21144 cumulative_compaction.cpp:112] There are missed versions among rowsets. prev rowset verison=[34235-34235], next rowset version=[34237-34237], tablet=1020802.276917532.044fcb9d5a58f77c-eb728622f29998b6
>W0212 16:43:50.862862 21144 cumulative_compaction.cpp:112] There are missed versions among rowsets. prev rowset verison=[34235-34235], next rowset version=[34237-34237], tablet=1020774.276917532.c044d2bf26a96a16-ab8648340b12a0be
>W0212 16:43:51.010138 21144 cumulative_compaction.cpp:112] There are missed versions among rowsets. prev rowset verison=[34181-34235], next rowset version=[34237-34237], tablet=1020810.276917532.8b4f63370dad3890-cb5a5c4c41153f83
>W0212 16:43:51.035369 21144 cumulative_compaction.cpp:112] There are missed versions among rowsets. prev rowset verison=[34205-34235], next rowset version=[34237-34237], tablet=1020798.276917532.e445a13b3295045e-4cb1238f530625bb
>W0212 16:43:52.992830 21144 cumulative_compaction.cpp:112] There are missed versions among rowsets. prev rowset verison=[34235-34235], next rowset version=[34237-34237], tablet=1020806.276917532.9d49f167f61a32a2-de4d451374a47cae
>W0212 16:43:53.043406 21144 cumulative_compaction.cpp:112] There are missed versions among rowsets. prev rowset verison=[34235-34235], next rowset version=[34237-34237], tablet=1020790.276917532.ec474f9b9e3b27fd-d96c05d874ce9186
>W0212 16:43:53.068686 21144 cumulative_compaction.cpp:112] There are missed versions among rowsets. prev rowset verison=[34235-34235], next rowset version=[34237-34237], tablet=1020786.276917532.89454e3d2fe4a0c2-6a494ce8f603a5ba
>W0212 16:43:55.564836 21144 cumulative_compaction.cpp:112] There are missed versions among rowsets. prev rowset verison=[34235-34235], next rowset version=[34237-34237], tablet=1020778.276917532.244d8cd50094d83d-2beda143c376479f
>W0212 16:43:55.860325 21144 cumulative_compaction.cpp:112] There are missed versions among rowsets. prev rowset verison=[34235-34235], next rowset version=[34237-34237], tablet=1020802.276917532.044fcb9d5a58f77c-eb728622f29998b6
>W0212 16:43:55.885744 21144 cumulative_compaction.cpp:112] There are missed versions among rowsets. prev rowset verison=[34235-34235], next rowset version=[34237-34237], tablet=1020774.276917532.c044d2bf26a96a16-ab8648340b12a0be
>W0212 16:43:56.029886 21144 cumulative_compaction.cpp:112] There are missed versions among rowsets. prev rowset verison=[34181-34235], next rowset version=[34237-34237], tablet=1020810.276917532.8b4f63370dad3890-cb5a5c4c41153f83
>W0212 16:43:56.054003 21144 cumulative_compaction.cpp:112] There are missed versions among rowsets. prev rowset verison=[34205-34235], next rowset version=[34237-34237], tablet=1020798.276917532.e445a13b3295045e-4cb1238f530625bb
>W0212 16:43:58.011371 21144 cumulative_compaction.cpp:112] There are missed versions among rowsets. prev rowset verison=[34235-34235], next rowset version=[34237-34237], tablet=1020806.276917532.9d49f167f61a32a2-de4d451374a47cae
>W0212 16:43:58.062548 21144 cumulative_compaction.cpp:112] There are missed versions among rowsets. prev rowset verison=[34235-34235], next rowset version=[34237-34237], tablet=1020790.276917532.ec474f9b9e3b27fd-d96c05d874ce9186
>W0212 16:43:58.088730 21144 cumulative_compaction.cpp:112] There are missed versions among rowsets. prev rowset verison=[34235-34235], next rowset version=[34237-34237], tablet=1020786.276917532.89454e3d2fe4a0c2-6a494ce8f603a5ba
>
>
>be.log日志文件较大不方便粘贴 ，还请帮忙协助一下
>感谢！
>
>________________________________________
>发件人: dev-help@doris.apache.org <de...@doris.apache.org>
>发送时间: 2023年2月13日 9:19
>收件人: 章志诚
>主题: ?????????????confirm subscribe to dev@doris.apache.org
>
>Hi! This is the ezmlm program. I'm managing the
>dev@doris.apache.org mailing list.
>
>I'm working for my owner, who can be reached
>at dev-owner@doris.apache.org.
>
>To confirm that you would like
>
> 2265@winnermedical.com
>
>added to the dev mailing list, please send
>a short reply to this address:
>
> dev-sc.1676251145.higodnbanpnlnbbodjok-2265=winnermedical.com@doris.apache.org
>
>Usually, this happens when you just hit the "reply" button.
>If this does not work, simply copy the address and paste it into
>the "To:" field of a new message.
>
>or click here:
> mailto:dev-sc.1676251145.higodnbanpnlnbbodjok-2265=winnermedical.com@doris.apache.org
>
>This confirmation serves two purposes. First, it verifies that I am able
>to get mail through to you. Second, it protects you in case someone
>forges a subscription request in your name.
>
>Please note that ALL Apache dev- and user- mailing lists are publicly
>archived. Do familiarize yourself with Apache's public archive policy at
>
> http://www.apache.org/foundation/public-archives.html
>
>prior to subscribing and posting messages to dev@doris.apache.org.
>If you're not sure whether or not the policy applies to this mailing list,
>assume it does unless the list name contains the word "private" in it.
>
>Some mail programs are broken and cannot handle long addresses. If you
>cannot reply to this request, instead send a message to
><de...@doris.apache.org> and put the
>entire address listed above into the "Subject:" line.
>
>
>--- Administrative commands for the dev list ---
>
>I can handle administrative requests automatically. Please
>do not send them to the list address! Instead, send
>your message to the correct command address:
>
>To subscribe to the list, send a message to:
> <de...@doris.apache.org>
>
>To remove your address from the list, send a message to:
> <de...@doris.apache.org>
>
>Send mail to the following for info and FAQ for this list:
> <de...@doris.apache.org>
> <de...@doris.apache.org>
>
>Similar addresses exist for the digest list:
> <de...@doris.apache.org>
> <de...@doris.apache.org>
>
>To get messages 123 through 145 (a maximum of 100 per request), mail:
> <de...@doris.apache.org>
>
>To get an index with subject and author for messages 123-456 , mail:
> <de...@doris.apache.org>
>
>They are always returned as sets of 100, max 2000 per request,
>so you'll actually get 100-499.
>
>To receive all messages with the same subject as message 12345,
>send a short message to:
> <de...@doris.apache.org>
>
>The messages should contain one line or word of text to avoid being
>treated as sp@m, but I will ignore their content.
>Only the ADDRESS you send to is important.
>
>You can start a subscription for an alternate address,
>for example "john@host.domain", just add a hyphen and your
>address (with '=' instead of '@') after the command word:
><de...@doris.apache.org>
>
>To stop subscription for this address, mail:
><de...@doris.apache.org>
>
>In both cases, I'll send a confirmation message to that address. When
>you receive it, simply reply to it to complete your subscription.
>
>If despite following these instructions, you do not get the
>desired results, please contact my owner at
>dev-owner@doris.apache.org. Please be patient, my owner is a
>lot slower than I am ;-)
>
>--- Enclosed is a copy of the request I received.
>
>Return-Path: <22...@winnermedical.com>
>Received: (qmail 237756 invoked by uid 116); 13 Feb 2023 01:19:04 -0000
>Received: from spamproc1-he-de.apache.org (HELO spamproc1-he-de.apache.org) (116.203.196.100)
> by apache.org (qpsmtpd/0.94) with ESMTP; Mon, 13 Feb 2023 01:19:04 +0000
>Authentication-Results: apache.org; auth=none
>Received: from localhost (localhost [127.0.0.1])
> by spamproc1-he-de.apache.org (ASF Mail Server at spamproc1-he-de.apache.org) with ESMTP id D477D1FF6C3
> for <de...@doris.apache.org>; Mon, 13 Feb 2023 01:19:04 +0000 (UTC)
>X-Virus-Scanned: Debian amavisd-new at spamproc1-he-de.apache.org
>X-Spam-Flag: NO
>X-Spam-Score: 3.924
>X-Spam-Level: ***
>X-Spam-Status: No, score=3.924 tagged_above=-999 required=6.31
> tests=[HTML_MESSAGE=0.2, MPART_ALT_DIFF=0.724,
> RCVD_IN_DNSWL_BLOCKED=0.001, RDNS_NONE=3, SPF_PASS=-0.001]
> autolearn=disabled
>Received: from mx1-ec2-va.apache.org ([116.203.227.195])
> by localhost (spamproc1-he-de.apache.org [116.203.196.100]) (amavisd-new, port 10024)
> with ESMTP id ypJns8XRVylS for <de...@doris.apache.org>;
> Mon, 13 Feb 2023 01:19:04 +0000 (UTC)
>Received-SPF: Pass (mailfrom) identity=mailfrom; client-ip=103.194.244.106; helo=spam.winnermedical.com; envelope-from=2265@winnermedical.com; receiver=<UNKNOWN>
>Received: from spam.winnermedical.com (unknown [103.194.244.106])
> by mx1-ec2-va.apache.org (ASF Mail Server at mx1-ec2-va.apache.org) with ESMTP id 5385FBCA28
> for <de...@doris.apache.org>; Mon, 13 Feb 2023 01:19:01 +0000 (UTC)
>Received: from SR-MBX-01.winnermedical.com ([172.16.100.30])
> by spam.winnermedical.com with ESMTPS id 31D1IM8w074938
> (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=FAIL)
> for <de...@doris.apache.org>; Mon, 13 Feb 2023 09:18:22 +0800 (GMT-8)
> (envelope-from 2265@winnermedical.com)
>Received: from SR-MBX-02.winnermedical.com (172.16.100.32) by
> SR-MBX-01.winnermedical.com (172.16.100.30) with Microsoft SMTP Server (TLS)
> id 15.0.1497.2; Mon, 13 Feb 2023 09:18:22 +0800
>Received: from SR-MBX-02.winnermedical.com ([fe80::68de:3d29:2c94:cc8a]) by
> SR-MBX-02.winnermedical.com ([fe80::68de:3d29:2c94:cc8a%18]) with mapi id
> 15.00.1497.000; Mon, 13 Feb 2023 09:18:22 +0800
>From: <22...@winnermedical.com>
>To: <de...@doris.apache.org>
>Subject: =?gb2312?B?ZG9yaXO1xGJlvdq14+W0u/o=?=
>Thread-Topic: =?gb2312?B?ZG9yaXO1xGJlvdq14+W0u/o=?=
>Thread-Index: AQHZP0kQY6g1r6ny0U2uaQQ6QD8VsQ==
>Date: Mon, 13 Feb 2023 01:18:21 +0000
>Message-ID: <8e...@SR-MBX-02.winnermedical.com>
>Accept-Language: zh-CN, en-US
>Content-Language: zh-CN
>X-MS-Has-Attach:
>X-MS-TNEF-Correlator:
>x-ms-exchange-transport-fromentityheader: Hosted
>x-originating-ip: [10.10.48.13]
>Content-Type: multipart/alternative;
> boundary="_000_8e24767e4dea49b88d0e655311aaf370SRMBX02winnermedicalcom_"
>MIME-Version: 1.0
>X-DNSRBL:
>X-SPAM-SOURCE-CHECK: pass
>X-MAIL:spam.winnermedical.com 31D1IM8w074938
>
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: dev-unsubscribe@doris.apache.org
>For additional commands, e-mail: dev-help@doris.apache.org
>