You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "qingbo jiao (Jira)" <ji...@apache.org> on 2023/07/12 06:59:00 UTC
[jira] [Updated] (SPARK-44381) How to specify parameters in spark-sumbit to make HiveDelegationTokenProvider refresh token regularly
[ https://issues.apache.org/jira/browse/SPARK-44381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
qingbo jiao updated SPARK-44381:
--------------------------------
Description:
export KRB5CCNAME=FILE:/tmp/krb5cc_1001
./bin/spark-submit -{-}master yarn --deploy-mode client --proxy-user xxxx --conf spark.app.name=spark-hive-test --conf spark.security.credentials.renewalRatio=0.000058 --conf spark.kerberos.renewal.credentials=ccache{-} -class org.apache.spark.examples.sql.hive.SparkHiveExample /examples/jars/spark-examples_2.12-3.1.1.jar
spark version 3.1.1，I configured it to refresh every 5 seconds。
--deploy-mode client/cluster wtih/without --proxy-user have all been tried, but none of them will work
Missing any configuration parameters？
was:
export KRB5CCNAME=FILE:/tmp/krb5cc_1001
./bin/spark-submit --master yarn --deploy-mode client --proxy-user ocdp --conf spark.app.name=spark-hive-test --conf spark.security.credentials.renewalRatio=0.000058 --conf spark.kerberos.renewal.credentials=ccache --class org.apache.spark.examples.sql.hive.SparkHiveExample /examples/jars/spark-examples_2.12-3.1.1.jar
spark version 3.1.1，I configured it to refresh every 5 seconds。
--deploy-mode client/cluster wtih/without --proxy-user have all been tried, but none of them will work
Missing any configuration parameters？
> How to specify parameters in spark-sumbit to make HiveDelegationTokenProvider refresh token regularly
> -----------------------------------------------------------------------------------------------------
>
> Key: SPARK-44381
> URL: https://issues.apache.org/jira/browse/SPARK-44381
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.1.1
> Reporter: qingbo jiao
> Priority: Minor
>
> export KRB5CCNAME=FILE:/tmp/krb5cc_1001
> ./bin/spark-submit -{-}master yarn --deploy-mode client --proxy-user xxxx --conf spark.app.name=spark-hive-test --conf spark.security.credentials.renewalRatio=0.000058 --conf spark.kerberos.renewal.credentials=ccache{-} -class org.apache.spark.examples.sql.hive.SparkHiveExample /examples/jars/spark-examples_2.12-3.1.1.jar
> spark version 3.1.1，I configured it to refresh every 5 seconds。
> --deploy-mode client/cluster wtih/without --proxy-user have all been tried, but none of them will work
> Missing any configuration parameters？
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org