You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Thomas Friedrich (JIRA)" <ji...@apache.org> on 2014/12/19 00:49:13 UTC
[jira] [Updated] (HIVE-8503) UT: add TestSparkMinimrCliDriver to
run UTs that use HDFS
[ https://issues.apache.org/jira/browse/HIVE-8503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Friedrich updated HIVE-8503:
-----------------------------------
Description:
The tests
empty_dir_in_table
file_with_header_footer
import_exported_table
load_hdfs_file_with_space_in_the_name
external_table_with_space_in_location_path
remote_script
root_dir_external_table
schemeAuthority
schemeAuthority2
temp_table_external
create directories in HDFS, but TestSparkCliDriver is not using HDFS.
That's why the tests fail when creating a dir, for example mkdir -p hdfs:///tmp/temp_table_external
In the non-spark case, these tests are executed with the TestMinimrCliDriver which initializes Hadoop and created a mini-cluster
(see configuration in itests/qtest/pom.xml).
We may need to configure a TestSparkMinimrCliDriver in itests/qtest-spark/pom.xml if we want to run these test cases.
was:
The tests
empty_dir_in_table
temp_table_external
load_hdfs_file_with_space_in_the_name
external_table_with_space_in_location_path
schemeAuthority2
create directories in HDFS, but TestSparkCliDriver is not using HDFS.
That's why the tests fail when creating a dir, for example mkdir -p hdfs:///tmp/temp_table_external
In the non-spark case, these tests are executed with the TestMinimrCliDriver which initializes Hadoop and created a mini-cluster
(see configuration in itests/qtest/pom.xml).
We may need to configure a TestSparkMinimrCliDriver in itests/qtest-spark/pom.xml if we want to run these test cases.
> UT: add TestSparkMinimrCliDriver to run UTs that use HDFS
> ---------------------------------------------------------
>
> Key: HIVE-8503
> URL: https://issues.apache.org/jira/browse/HIVE-8503
> Project: Hive
> Issue Type: Sub-task
> Components: Spark
> Reporter: Thomas Friedrich
> Assignee: Thomas Friedrich
> Priority: Minor
>
> The tests
> empty_dir_in_table
> file_with_header_footer
> import_exported_table
> load_hdfs_file_with_space_in_the_name
> external_table_with_space_in_location_path
> remote_script
> root_dir_external_table
> schemeAuthority
> schemeAuthority2
> temp_table_external
> create directories in HDFS, but TestSparkCliDriver is not using HDFS.
> That's why the tests fail when creating a dir, for example mkdir -p hdfs:///tmp/temp_table_external
> In the non-spark case, these tests are executed with the TestMinimrCliDriver which initializes Hadoop and created a mini-cluster
> (see configuration in itests/qtest/pom.xml).
> We may need to configure a TestSparkMinimrCliDriver in itests/qtest-spark/pom.xml if we want to run these test cases.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)