[jira] [Updated] (IMPALA-14553) Speed up generate-schema-statements

["Michael Smith (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IMPALA-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael Smith updated IMPALA-14553:
-----------------------------------
    Component/s: Infrastructure

> Speed up generate-schema-statements
> -----------------------------------
>
>                 Key: IMPALA-14553
>                 URL: https://issues.apache.org/jira/browse/IMPALA-14553
>             Project: IMPALA
>          Issue Type: Task
>          Components: Infrastructure
>            Reporter: Michael Smith
>            Assignee: Michael Smith
>            Priority: Minor
>
> Just generating the schemas for functional-query with
> {code}
> ./testdata/bin/generate-schema-statements.py --workload=functional-query
> {code}
> can take over 2 minutes. Most of that time is spent handling eval statements in functional_schema_template.sql (the shell commands that start with {{`}}). {{eval_section}} is called for each row in test_vectors, even though the operations don't change.
> We can speed this up by running {{eval_section}} once for each field, and running them in parallel.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org