[jira] [Created] (IMPALA-14437) FileMetadataLoader.createFd() regress after IMPALA-14349

["Riza Suminto (Jira)" <ji...@apache.org>]

Riza Suminto created IMPALA-14437:
-------------------------------------

             Summary: FileMetadataLoader.createFd() regress after IMPALA-14349
                 Key: IMPALA-14437
                 URL: https://issues.apache.org/jira/browse/IMPALA-14437
             Project: IMPALA
          Issue Type: Bug
          Components: Catalog
    Affects Versions: Impala 5.0.0
            Reporter: Riza Suminto
            Assignee: Riza Suminto


IMPALA-14349 caused a regression due to change in FileMetadataLoader.createFd(). When default FS is S3, all files is S3 should not have any FileBlock. However, after IMPALA-14349, CTAS query that scans functional.alltypes table in S3 hit following Preconditions in HdfsScanNode.java:
{code:java}
  if (!fsHasBlocks) {
    Preconditions.checkState(fileDesc.getNumFileBlocks() == 0);{code}
Following is the snippet from the log.
{code:java}
I20250910 07:36:52.709887 63842 Frontend.java:2431] 8a47939d765631e1:4821604e00000000] Analyzing query: INSERT into TABLE functional_kudu.alltypes
SELECT id, bool_col, tinyint_col, smallint_col, int_col, bigint_col, float_col, double_col, date_string_col, string_col,
       timestamp_col, year, month
FROM functional.alltypes db: default...I20250910 07:36:52.956176 63842 jni-util.cc:321] 8a47939d765631e1:4821604e00000000] java.lang.IllegalStateException
        at com.google.common.base.Preconditions.checkState(Preconditions.java:496)
        at org.apache.impala.planner.HdfsScanNode.computeScanRangeLocations(HdfsScanNode.java:1364)
        at org.apache.impala.planner.HdfsScanNode.init(HdfsScanNode.java:444)
        at org.apache.impala.planner.SingleNodePlanner.createHdfsScanPlan(SingleNodePlanner.java:1684)
        at org.apache.impala.planner.SingleNodePlanner.createScanNode(SingleNodePlanner.java:1906)
        at org.apache.impala.planner.SingleNodePlanner.createTableRefNode(SingleNodePlanner.java:2235)
        at org.apache.impala.planner.SingleNodePlanner.createTableRefsPlan(SingleNodePlanner.java:937)
        at org.apache.impala.planner.SingleNodePlanner.createSelectPlan(SingleNodePlanner.java:752)
        at org.apache.impala.planner.SingleNodePlanner.createQueryPlan(SingleNodePlanner.java:284)
        at org.apache.impala.planner.SingleNodePlanner.createSingleNodePlan(SingleNodePlanner.java:176)
        at org.apache.impala.planner.Planner.createPlanFragments(Planner.java:137)
        at org.apache.impala.planner.Planner.createPlans(Planner.java:312)
        at org.apache.impala.service.Frontend.createExecRequest(Frontend.java:2031)
        at org.apache.impala.service.Frontend.getPlannedExecRequest(Frontend.java:3356)
        at org.apache.impala.service.Frontend.doCreateExecRequest(Frontend.java:3130)
        at org.apache.impala.service.Frontend.getTExecRequest(Frontend.java:2538)
        at org.apache.impala.service.Frontend.getTExecRequestWithFallback(Frontend.java:2407)
        at org.apache.impala.service.Frontend.createExecRequest(Frontend.java:2096)
        at org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:176)
I20250910 07:36:52.956212 63842 status.cc:129] 8a47939d765631e1:4821604e00000000] IllegalStateException: null {code}
This is because, after IMPALA-14349, FileMetadataLoader.createFd() skip checking if the originating FileSystem support supportsStorageIds() or not.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org