You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@doris.apache.org by 潘庭锋 <pa...@pcitech.com> on 2025/03/20 03:29:16 UTC
Subject: Multi-Condition Query on Hive External Table Causes All BE Nodes to Crash (Doris 3.0.2 + Hive 3.1.0)
Dear Doris Community/Support Team,
I hope this email finds you well. I am writing to report an issue encountered while querying a Hive external table via Doris, which leads to BE node crashes. Your expertise would be greatly appreciated in resolving this problem.
github issue: https://github.com/apache/doris/issues/49034
Environment Details
Doris Version: 3.0.2
Hive Version: 3.1.0.3.1.5.0-152
Issue Description:
When querying a Hive external table with multiple non-partition column filters (e.g., PERSON_ID, RECORD_ID, CARD_PHYSICAL_ID), all BE nodes crash and return the error io.grpc.StatusRuntimeException: UNAVAILABLE: Network closed for unknown reason.
Error Details:
●Client Error:复制SQL error [1105] [HY000]: RpcException, msg: io.grpc.StatusRuntimeException: UNAVAILABLE: Network closed for unknown reason
●Reproducibility:
○Stably Reproducible when querying with non-partition column filters on a large table (~300 million rows).
○Works Correctly if:
■Query includes all partition columns (stat_day and order_type).
■Query is simple (e.g., no WHERE clause or only partition column filters).
■Table size is small.
Request for Support:
Could you help investigate:
1. Why non-partition column filters cause BE crashes on large tables?
2. Whether this is related to metadata propagation, predicate pushdown, or resource constraints (e.g., memory/network)?
3. Required configurations to avoid such crashes.
Thank you for your assistance!
Best regards,
Tingfeng Pan
Re:Subject: Multi-Condition Query on Hive External Table Causes All BE Nodes to Crash (Doris 3.0.2 + Hive 3.1.0)
Posted by Mingyu Chen <mo...@163.com>.
I've commented in on issue, PTAL
--
Best Regards
Mingyu Chen
Email:
morningman@apache.org
At 2025-03-20 11:29:16, "潘庭锋" <pa...@pcitech.com> wrote:
>Dear Doris Community/Support Team,
>I hope this email finds you well. I am writing to report an issue encountered while querying a Hive external table via Doris, which leads to BE node crashes. Your expertise would be greatly appreciated in resolving this problem.
>
>
>github issue: https://github.com/apache/doris/issues/49034
>
>
>
>Environment Details
>
>Doris Version: 3.0.2
>
>
>Hive Version: 3.1.0.3.1.5.0-152
>
>
>
>Issue Description:
>
>When querying a Hive external table with multiple non-partition column filters (e.g., PERSON_ID, RECORD_ID, CARD_PHYSICAL_ID), all BE nodes crash and return the error io.grpc.StatusRuntimeException: UNAVAILABLE: Network closed for unknown reason.
>
>
>
>
>
>Error Details:
>●Client Error:复制SQL error [1105] [HY000]: RpcException, msg: io.grpc.StatusRuntimeException: UNAVAILABLE: Network closed for unknown reason
>●Reproducibility:
>○Stably Reproducible when querying with non-partition column filters on a large table (~300 million rows).
>○Works Correctly if:
>■Query includes all partition columns (stat_day and order_type).
>■Query is simple (e.g., no WHERE clause or only partition column filters).
>■Table size is small.
>
>
>
>
>
>
>
>
>Request for Support:
>Could you help investigate:
>1. Why non-partition column filters cause BE crashes on large tables?
>2. Whether this is related to metadata propagation, predicate pushdown, or resource constraints (e.g., memory/network)?
>3. Required configurations to avoid such crashes.
>
>
>Thank you for your assistance!
>
>Best regards,
>
>
>Tingfeng Pan