You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Quanlong Huang (Jira)" <ji...@apache.org> on 2023/09/07 03:14:00 UTC

[jira] [Resolved] (IMPALA-11121) Support loading testdata in JSON format

     [ https://issues.apache.org/jira/browse/IMPALA-11121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Quanlong Huang resolved IMPALA-11121.
-------------------------------------
    Fix Version/s: Impala 4.3.0
       Resolution: Duplicate

Test data is added in IMPALA-10798. Thank [~Eyizoha]!

> Support loading testdata in JSON format
> ---------------------------------------
>
>                 Key: IMPALA-11121
>                 URL: https://issues.apache.org/jira/browse/IMPALA-11121
>             Project: IMPALA
>          Issue Type: Sub-task
>          Components: Infrastructure
>            Reporter: Quanlong Huang
>            Assignee: Ye Zihao
>            Priority: Major
>             Fix For: Impala 4.3.0
>
>
> For test coverage, we should generate test data in JSON format and run existing tests on it. We should at least support 'json/none/none'. Other formats like 'json/gzip/none', 'json/snap/none' could be optional.
>  The goal of this JIRA is being able to generate sufficient testdata for IMPALA-10798. E.g. we should be able to load JSON tables using
> {code}
> ./bin/load-data.py -w functional-query --exploration_strategy=exhaustive --table_formats=json/none/none
> ./bin/load-data.py -w tpch --exploration_strategy=core --table_formats=json/none/none
> ./bin/load-data.py -w tpcds --exploration_strategy=core --table_formats=json/none/none
> {code}
> Then in IMPALA-10798, we can trigger tests on the json format, e.g.
> {code}
> impala-py.test --table_formats=json/none tests/query_test/test_scanners.py
> impala-py.test --table_formats=json/none tests/query_test/test_scanners_fuzz.py
> {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)