You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Shohei Okumiya (Jira)" <ji...@apache.org> on 2025/04/14 06:08:00 UTC

[jira] [Resolved] (HIVE-19910) hive.spark.log.dir isn't honored for TestSparkCliDriver

     [ https://issues.apache.org/jira/browse/HIVE-19910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shohei Okumiya resolved HIVE-19910.
-----------------------------------
    Fix Version/s: NA
       Resolution: Won't Fix

We have discontinued Hive on Spark and EoLed Hive 3. HIVE-26134

> hive.spark.log.dir isn't honored for TestSparkCliDriver
> -------------------------------------------------------
>
>                 Key: HIVE-19910
>                 URL: https://issues.apache.org/jira/browse/HIVE-19910
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Spark
>            Reporter: Sahil Takiar
>            Priority: Major
>             Fix For: NA
>
>
> I haven't actually confirmed this, but I don't think {{hive.spark.log.dir}} is getting honored for any Spark test that sets {{spark.master}} to {{local-cluster}} because it adds {{hive.spark.log.dir}} as a system property via the {{spark.driver.extraJavaOptions}} configuration, but according to the Spark docs passing system properties via this parameter doesn't work in client mode, users have to use {{--driver-java-options}} instead.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)