You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Thomas Friedrich (JIRA)" <ji...@apache.org> on 2014/10/18 00:03:34 UTC

[jira] [Created] (HIVE-8503) UT: add TestSparkMinimrCliDriver to run UTs that use HDFS

Thomas Friedrich created HIVE-8503:
--------------------------------------

             Summary: UT: add TestSparkMinimrCliDriver to run UTs that use HDFS
                 Key: HIVE-8503
                 URL: https://issues.apache.org/jira/browse/HIVE-8503
             Project: Hive
          Issue Type: Sub-task
          Components: Spark
            Reporter: Thomas Friedrich
            Priority: Minor


The 3 tests
temp_table_external
load_hdfs_file_with_space_in_the_name
external_table_with_space_in_location_path
create directories in HDFS, but TestSparkCliDriver is not using HDFS. 

That's why the tests fail when creating a dir, for example mkdir -p hdfs:///tmp/temp_table_external
In the non-spark case, these tests are executed with the TestMinimrCliDriver which initializes Hadoop and created a mini-cluster
(see configuration in itests/qtest/pom.xml).

We may need to configure a TestSparkMinimrCliDriver in itests/qtest-spark/pom.xml if we want to run these test cases.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)