You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Quanlong Huang (Jira)" <ji...@apache.org> on 2020/04/22 23:13:00 UTC
[jira] [Commented] (IMPALA-9678) Dockerised tests with
USE_CDP_HIVE=true crash with orc-metadata-utils.cc DCHECK
[ https://issues.apache.org/jira/browse/IMPALA-9678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17090077#comment-17090077 ]
Quanlong Huang commented on IMPALA-9678:
----------------------------------------
The query is
{code}
I0419 03:32:48.789677 31825 Frontend.java:1490] 444f457c178cfeff:de098d6100000000] Analyzing query: select count(l_returnflag) pk from lineitem db: tpch_orc_def
{code}
This will be resolved once the patch for IMPALA-9685 is merged.
> Dockerised tests with USE_CDP_HIVE=true crash with orc-metadata-utils.cc DCHECK
> -------------------------------------------------------------------------------
>
> Key: IMPALA-9678
> URL: https://issues.apache.org/jira/browse/IMPALA-9678
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Affects Versions: Impala 4.0
> Reporter: Joe McDonnell
> Priority: Blocker
> Labels: broken-build
>
> I ran a ubuntu-16.04-dockerised-tests-cdp-hive on master, and all of the Impalads crashed with this message during end-to-end tests:
> {noformat}
> F0419 03:32:48.973024 31936 orc-metadata-utils.cc:160] 444f457c178cfeff:de098d6100000001] Check failed: i == col_path.size() - 1 (0 vs. 1)
> F0419 03:32:48.974320 31935 orc-metadata-utils.cc:160] 444f457c178cfeff:de098d6100000001] Check failed: i == col_path.size() - 1 (0 vs. 1)
> F0419 03:32:48.974320 31935 orc-metadata-utils.cc:160] 444f457c178cfeff:de098d6100000001] Check failed: i == col_path.size() - 1 (0 vs. 1) F0419 03:32:48.981420 31937 orc-metadata-utils.cc:160] 444f457c178cfeff:de098d6100000001] Check failed: i == col_path.size() - 1 (0 vs. 1)
> F0419 03:32:48.974320 31935 orc-metadata-utils.cc:160] 444f457c178cfeff:de098d6100000001] Check failed: i == col_path.size() - 1 (0 vs. 1) F0419 03:32:48.981420 31937 orc-metadata-utils.cc:160] 444f457c178cfeff:de098d6100000001] Check failed: i == col_path.size() - 1 (0 vs. 1) F0419 03:32:48.983081 31938 orc-metadata-utils.cc:160] 444f457c178cfeff:de098d6100000001] Check failed: i == col_path.size() - 1 (0 vs. 1) {noformat}
> It's coming from this DCHECK:
> {code:java}
> if (table_col_type->type == TYPE_ARRAY) {
> ...
> } else if (table_col_type->type == TYPE_MAP) {
> ...
> } else if (table_col_type->type == TYPE_STRUCT) {
> ...
> } else {
> DCHECK(!table_col_type->IsComplexType());
> DCHECK_EQ(i, col_path.size() - 1); <--------
> RETURN_IF_ERROR(ValidateType(*table_col_type, **node));
> }
> {code}
> [https://github.com/apache/impala/blob/master/be/src/exec/orc-metadata-utils.cc#L160]
> [https://jenkins.impala.io/job/ubuntu-16.04-dockerised-tests-cdp-hive/4/]
> This matches the GVO failures that we saw when trying to set USE_CDP_HIVE=true by default ([https://gerrit.cloudera.org/#/c/15710/]). It seems to reproduce consistently, but only on the dockerised job.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org