You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Quanlong Huang (Jira)" <ji...@apache.org> on 2023/09/07 03:14:00 UTC
[jira] [Resolved] (IMPALA-11121) Support loading testdata in JSON format
[ https://issues.apache.org/jira/browse/IMPALA-11121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Quanlong Huang resolved IMPALA-11121.
-------------------------------------
Fix Version/s: Impala 4.3.0
Resolution: Duplicate
Test data is added in IMPALA-10798. Thank [~Eyizoha]!
> Support loading testdata in JSON format
> ---------------------------------------
>
> Key: IMPALA-11121
> URL: https://issues.apache.org/jira/browse/IMPALA-11121
> Project: IMPALA
> Issue Type: Sub-task
> Components: Infrastructure
> Reporter: Quanlong Huang
> Assignee: Ye Zihao
> Priority: Major
> Fix For: Impala 4.3.0
>
>
> For test coverage, we should generate test data in JSON format and run existing tests on it. We should at least support 'json/none/none'. Other formats like 'json/gzip/none', 'json/snap/none' could be optional.
> The goal of this JIRA is being able to generate sufficient testdata for IMPALA-10798. E.g. we should be able to load JSON tables using
> {code}
> ./bin/load-data.py -w functional-query --exploration_strategy=exhaustive --table_formats=json/none/none
> ./bin/load-data.py -w tpch --exploration_strategy=core --table_formats=json/none/none
> ./bin/load-data.py -w tpcds --exploration_strategy=core --table_formats=json/none/none
> {code}
> Then in IMPALA-10798, we can trigger tests on the json format, e.g.
> {code}
> impala-py.test --table_formats=json/none tests/query_test/test_scanners.py
> impala-py.test --table_formats=json/none tests/query_test/test_scanners_fuzz.py
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)