You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Quanlong Huang (Jira)" <ji...@apache.org> on 2022/06/01 06:40:00 UTC
[jira] [Updated] (IMPALA-11121) Support loading testdata in JSON format
[ https://issues.apache.org/jira/browse/IMPALA-11121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Quanlong Huang updated IMPALA-11121:
------------------------------------
Description:
For test coverage, we should generate test data in JSON format and run existing tests on it. We should at least support 'json/none/none'. Other formats like 'json/gzip/none', 'json/snap/none' could be optional.
The goal of this JIRA is being able to generate sufficient testdata for IMPALA-10798. E.g. we should be able to load JSON tables using
{code}
./bin/load-data.py -w functional-query --exploration_strategy=exhaustive --table_formats=json/none/none
./bin/load-data.py -w tpch --exploration_strategy=core --table_formats=json/none/none
./bin/load-data.py -w tpcds --exploration_strategy=core --table_formats=json/none/none
{code}
Then in IMPALA-10798, we can trigger tests on the json format, e.g.
{code}
impala-py.test --table_formats=json/none tests/query_test/test_scanners.py
impala-py.test --table_formats=json/none tests/query_test/test_scanners_fuzz.py
{code}
was:For test coverage, we should generate test data in JSON format and run existing tests on it. We should at least support 'json/none/none'. Other formats like 'json/gzip/none', 'json/snap/none' could be optional.
> Support loading testdata in JSON format
> ---------------------------------------
>
> Key: IMPALA-11121
> URL: https://issues.apache.org/jira/browse/IMPALA-11121
> Project: IMPALA
> Issue Type: Sub-task
> Components: Infrastructure
> Reporter: Quanlong Huang
> Assignee: Pranav Yogi Lodha
> Priority: Major
>
> For test coverage, we should generate test data in JSON format and run existing tests on it. We should at least support 'json/none/none'. Other formats like 'json/gzip/none', 'json/snap/none' could be optional.
> The goal of this JIRA is being able to generate sufficient testdata for IMPALA-10798. E.g. we should be able to load JSON tables using
> {code}
> ./bin/load-data.py -w functional-query --exploration_strategy=exhaustive --table_formats=json/none/none
> ./bin/load-data.py -w tpch --exploration_strategy=core --table_formats=json/none/none
> ./bin/load-data.py -w tpcds --exploration_strategy=core --table_formats=json/none/none
> {code}
> Then in IMPALA-10798, we can trigger tests on the json format, e.g.
> {code}
> impala-py.test --table_formats=json/none tests/query_test/test_scanners.py
> impala-py.test --table_formats=json/none tests/query_test/test_scanners_fuzz.py
> {code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org