You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@impala.apache.org by Jin Chul Kim <ji...@gmail.com> on 2017/11/08 06:17:39 UTC

A question about loading data by functional-query workload

Hi,

I would like to run E2E test using the document:
https://cwiki.apache.org/confluence/display/IMPALA/How+to+load+and+run+Impala+tests
.

Here is my command: ./tests/run-tests.py query_test/test_queries.py -k
TestQueriesTextTables

It failed with not found functional database. Should I load data manually?
Anyway, I found ./bin/load-data.sh by chance and I ran it with the
command: ./bin/load-data.py -w functional-query
By the way, it failed with not found matching path file:
${IMPALA_HOME}/testdata/target/AllTypes/090101.txt. I don't find the
directory ${IMPALA_HOME}/testdata/target/AllTypes. I guess it can be
generated internally. Would you please guide me?

0: jdbc:hive2://localhost:11050/default> LOAD DATA LOCAL INPATH
'/home/jinchulkim/workspace/Impala/testdata/target/AllTypes/090101.txt'
OVERWRITE INTO TABLE functional.alltypes PARTITION(year=2009, month=1);
going to print operations logs
printed operations logs
Getting log thread is interrupted, since query is done!
Error: Error while compiling statement: FAILED: SemanticException Line 1:23
Invalid path
''/home/jinchulkim/workspace/Impala/testdata/target/AllTypes/090101.txt'':
No files matching path
file:/home/jinchulkim/workspace/Impala/testdata/target/AllTypes/090101.txt
(state=42000,code=40000)
org.apache.hive.service.cli.HiveSQLException: Error while compiling
statement: FAILED: SemanticException Line 1:23 Invalid path
''/home/jinchulkim/workspace/Impala/testdata/target/AllTypes/090101.txt'':
No files matching path
file:/home/jinchulkim/workspace/Impala/testdata/target/AllTypes/090101.txt

Best regards,
Jinchul

Re: A question about loading data by functional-query workload

Posted by Jim Apple <jb...@cloudera.com>.
The recommended way to get a development environment set up calls
https://github.com/apache/incubator-impala/blob/master/bin/bootstrap_development.sh
which calls /buildall.sh -noclean -format -testdata -skiptests. That
is the recommended way to load the test data.

On Tue, Nov 7, 2017 at 10:17 PM, Jin Chul Kim <ji...@gmail.com> wrote:
> Hi,
>
> I would like to run E2E test using the document:
> https://cwiki.apache.org/confluence/display/IMPALA/How+to+load+and+run+Impala+tests
> .
>
> Here is my command: ./tests/run-tests.py query_test/test_queries.py -k
> TestQueriesTextTables
>
> It failed with not found functional database. Should I load data manually?
> Anyway, I found ./bin/load-data.sh by chance and I ran it with the
> command: ./bin/load-data.py -w functional-query
> By the way, it failed with not found matching path file:
> ${IMPALA_HOME}/testdata/target/AllTypes/090101.txt. I don't find the
> directory ${IMPALA_HOME}/testdata/target/AllTypes. I guess it can be
> generated internally. Would you please guide me?
>
> 0: jdbc:hive2://localhost:11050/default> LOAD DATA LOCAL INPATH
> '/home/jinchulkim/workspace/Impala/testdata/target/AllTypes/090101.txt'
> OVERWRITE INTO TABLE functional.alltypes PARTITION(year=2009, month=1);
> going to print operations logs
> printed operations logs
> Getting log thread is interrupted, since query is done!
> Error: Error while compiling statement: FAILED: SemanticException Line 1:23
> Invalid path
> ''/home/jinchulkim/workspace/Impala/testdata/target/AllTypes/090101.txt'':
> No files matching path
> file:/home/jinchulkim/workspace/Impala/testdata/target/AllTypes/090101.txt
> (state=42000,code=40000)
> org.apache.hive.service.cli.HiveSQLException: Error while compiling
> statement: FAILED: SemanticException Line 1:23 Invalid path
> ''/home/jinchulkim/workspace/Impala/testdata/target/AllTypes/090101.txt'':
> No files matching path
> file:/home/jinchulkim/workspace/Impala/testdata/target/AllTypes/090101.txt
>
> Best regards,
> Jinchul