You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Alexander Behm (JIRA)" <ji...@apache.org> on 2018/03/08 00:19:00 UTC

[jira] [Created] (IMPALA-6626) Failure to assign dictionary predicates should not result in query failure

Alexander Behm created IMPALA-6626:
--------------------------------------

             Summary: Failure to assign dictionary predicates should not result in query failure
                 Key: IMPALA-6626
                 URL: https://issues.apache.org/jira/browse/IMPALA-6626
             Project: IMPALA
          Issue Type: Improvement
          Components: Frontend
    Affects Versions: Impala 2.11.0, Impala 2.10.0, Impala 2.9.0
            Reporter: Alexander Behm


Assigning dictionary predicates to Parquet scans may involve evaluation of expressions in the BE which could fail for various reasons. Such failures should lead to non-assignment of dictionary predicates but not to query failure.

See HdfsScanNode:
{code}
private void addDictionaryFilter(...) {
...
    try {
      if (analyzer.isTrueWithNullSlots(conjunct)) return;
    } catch (InternalException e) { <--- does not handle Exception which will cause query to fail
      // Expr evaluation failed in the backend. Skip this conjunct since we cannot
      // determine whether it is safe to apply it against a dictionary.
      LOG.warn("Skipping dictionary filter because backend evaluation failed: "
          + conjunct.toSql(), e);
      return;
    }
}
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)