[jira] [Commented] (IMPALA-11121) Support loading testdata in JSON format

["Quanlong Huang (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-11121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17544728#comment-17544728 ] 

Quanlong Huang commented on IMPALA-11121:
-----------------------------------------

Some resources:
https://cwiki.apache.org/confluence/display/IMPALA/Impala+Test+Data
https://cwiki.apache.org/confluence/display/IMPALA/How+to+load%2C+run%2C+and+create+new+Impala+tests
https://github.com/apache/impala/blob/branch-4.1.0/testdata/datasets/README

We add the testdata for ORC format in this patch: https://gerrit.cloudera.org/c/9134/
Probably we need to do the same for JSON. E.g. in build_table_template of generate-schema-statements.py, add codes for JSON tables:
https://github.com/apache/impala/blob/branch-4.1.0/testdata/bin/generate-schema-statements.py#L284

generate-schema-statements.py is where we parse the sql template files, e.g. testdata/datasets/functional/functional_schema_template.sql,  and generates the sql files.

> Support loading testdata in JSON format
> ---------------------------------------
>
>                 Key: IMPALA-11121
>                 URL: https://issues.apache.org/jira/browse/IMPALA-11121
>             Project: IMPALA
>          Issue Type: Sub-task
>          Components: Infrastructure
>            Reporter: Quanlong Huang
>            Assignee: Pranav Yogi Lodha
>            Priority: Major
>
> For test coverage, we should generate test data in JSON format and run existing tests on it. We should at least support 'json/none/none'. Other formats like 'json/gzip/none', 'json/snap/none' could be optional.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org