You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Shohei Okumiya (Jira)" <ji...@apache.org> on 2025/04/14 06:50:00 UTC
[jira] [Resolved] (HIVE-8503) UT: add TestSparkMinimrCliDriver to run UTs that use HDFS
[ https://issues.apache.org/jira/browse/HIVE-8503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shohei Okumiya resolved HIVE-8503.
----------------------------------
Fix Version/s: NA
Resolution: Won't Fix
We have discontinued Hive on Spark and EoLed Hive 3. HIVE-26134
> UT: add TestSparkMinimrCliDriver to run UTs that use HDFS
> ---------------------------------------------------------
>
> Key: HIVE-8503
> URL: https://issues.apache.org/jira/browse/HIVE-8503
> Project: Hive
> Issue Type: Sub-task
> Components: Spark
> Reporter: Thomas Friedrich
> Assignee: Thomas Friedrich
> Priority: Minor
> Fix For: NA
>
>
> The tests
> empty_dir_in_table
> file_with_header_footer
> import_exported_table
> load_hdfs_file_with_space_in_the_name
> external_table_with_space_in_location_path
> load_fs2
> remote_script
> root_dir_external_table
> schemeAuthority
> schemeAuthority2
> temp_table_external
> udf_using
> create directories in HDFS, but TestSparkCliDriver is not using HDFS.
> That's why the tests fail when creating a dir, for example mkdir -p hdfs:///tmp/temp_table_external
> In the non-spark case, these tests are executed with the TestMinimrCliDriver which initializes Hadoop and created a mini-cluster
> (see configuration in itests/qtest/pom.xml).
> We may need to configure a TestSparkMinimrCliDriver in itests/qtest-spark/pom.xml if we want to run these test cases.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)