[jira] [Created] (HAWQ-297) Double check hdfs and split length equals to metadata logic length.

["Hubert Zhang (JIRA)" <ji...@apache.org>]

Hubert Zhang created HAWQ-297:
---------------------------------

             Summary: Double check hdfs and split length equals to metadata logic length.
                 Key: HAWQ-297
                 URL: https://issues.apache.org/jira/browse/HAWQ-297
             Project: Apache HAWQ
          Issue Type: Improvement
          Components: Core
            Reporter: Hubert Zhang
            Assignee: Lei Chang


for each table, we store file logic length in pg_aoseg metadata table.
when scanning tables, we obtain blocks information from HDFS(or cache)
we need to ensure the file length in HDFS equals to the logic  length of file in pg_aoseg.
Again, we also need to ensure after we assign each blocks to virtual segments, the total length of splits equals to the logic  length of file in pg_aoseg.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)