You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@airflow.apache.org by "Fokko Driesprong (JIRA)" <ji...@apache.org> on 2017/11/27 07:07:00 UTC

[jira] [Closed] (AIRFLOW-1831) Add Spark submit driver classpath parameter

     [ https://issues.apache.org/jira/browse/AIRFLOW-1831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Fokko Driesprong closed AIRFLOW-1831.
-------------------------------------
       Resolution: Fixed
    Fix Version/s: 1.9.1

> Add Spark submit driver classpath parameter
> -------------------------------------------
>
>                 Key: AIRFLOW-1831
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1831
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: hooks, operators
>            Reporter: Daniel van der Ende
>            Assignee: Daniel van der Ende
>            Priority: Minor
>             Fix For: 1.9.1
>
>
> Spark allows you to set the classpath for the driver only. This can save overhead, if you only need a specific jar on the driver, for instance. The Airflow spark_submit_operator/spark_submit_hook do not support this. This should be added.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)