You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Shohei Okumiya (Jira)" <ji...@apache.org> on 2025/04/14 06:08:00 UTC
[jira] [Resolved] (HIVE-19910) hive.spark.log.dir isn't honored for TestSparkCliDriver
[ https://issues.apache.org/jira/browse/HIVE-19910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shohei Okumiya resolved HIVE-19910.
-----------------------------------
Fix Version/s: NA
Resolution: Won't Fix
We have discontinued Hive on Spark and EoLed Hive 3. HIVE-26134
> hive.spark.log.dir isn't honored for TestSparkCliDriver
> -------------------------------------------------------
>
> Key: HIVE-19910
> URL: https://issues.apache.org/jira/browse/HIVE-19910
> Project: Hive
> Issue Type: Sub-task
> Components: Spark
> Reporter: Sahil Takiar
> Priority: Major
> Fix For: NA
>
>
> I haven't actually confirmed this, but I don't think {{hive.spark.log.dir}} is getting honored for any Spark test that sets {{spark.master}} to {{local-cluster}} because it adds {{hive.spark.log.dir}} as a system property via the {{spark.driver.extraJavaOptions}} configuration, but according to the Spark docs passing system properties via this parameter doesn't work in client mode, users have to use {{--driver-java-options}} instead.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)