You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2016/01/27 14:03:39 UTC
[jira] [Assigned] (SPARK-13040) JDBC using SPARK_CLASSPATH is
deprecated but is the only way documented
[ https://issues.apache.org/jira/browse/SPARK-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Apache Spark reassigned SPARK-13040:
------------------------------------
Assignee: Apache Spark
> JDBC using SPARK_CLASSPATH is deprecated but is the only way documented
> -----------------------------------------------------------------------
>
> Key: SPARK-13040
> URL: https://issues.apache.org/jira/browse/SPARK-13040
> Project: Spark
> Issue Type: Documentation
> Components: Documentation, Examples
> Affects Versions: 1.6.0
> Reporter: Sebastián RamÃrez
> Assignee: Apache Spark
> Priority: Minor
>
> The documentation says that to use a JDBC driver it must be set with the environment variable SPARK_CLASSPATH, as in:
> {code}
> SPARK_CLASSPATH=postgresql-9.3-1102-jdbc41.jar bin/spark-shell
> {code}
> http://spark.apache.org/docs/latest/sql-programming-guide.html#jdbc-to-other-databases
> But when run like that, the output says that using that environment variable is deprecated:
> {code}
> SPARK_CLASSPATH was detected (set to '/home/senseta/postgresql-9.4.1207.jre7.jar').
> This is deprecated in Spark 1.0+.
> Please instead use:
> - ./spark-submit with --driver-class-path to augment the driver classpath
> - spark.executor.extraClassPath to augment the executor classpath
> 16/01/27 13:36:57 WARN spark.SparkConf: Setting 'spark.executor.extraClassPath' to '/home/senseta/postgresql-9.4.1207.jre7.jar' as a work-around.
> 16/01/27 13:36:57 WARN spark.SparkConf: Setting 'spark.driver.extraClassPath' to '/home/senseta/postgresql-9.4.1207.jre7.jar' as a work-around.
> {code}
> It would be good to have an example with the current official syntax (I'm actually not sure of which would be the correct parameters), for Scala and Python (in case they differ).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org