You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2019/01/21 14:46:00 UTC

[jira] [Commented] (AIRFLOW-1191) Contrib Spark Submit hook should permit override of spark-submit cmd

    [ https://issues.apache.org/jira/browse/AIRFLOW-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16747995#comment-16747995 ] 

ASF GitHub Bot commented on AIRFLOW-1191:
-----------------------------------------

Fokko commented on pull request #4360: [AIRFLOW-1191] Simplify override of spark submit command
URL: https://github.com/apache/airflow/pull/4360
 
 
   
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Contrib Spark Submit hook should permit override of spark-submit cmd
> --------------------------------------------------------------------
>
>                 Key: AIRFLOW-1191
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1191
>             Project: Apache Airflow
>          Issue Type: Improvement
>          Components: contrib, hooks
>    Affects Versions: 1.8.1
>         Environment: Cloudera based Spark parcel
>            Reporter: Vianney FOUCAULT
>            Assignee: Vianney FOUCAULT
>            Priority: Major
>             Fix For: 1.10.0
>
>
> Using Cloudera based cluster with spark 2 parcel that rename spark-submit to spark2-submit
> It should be possible to change the spark submit cmd without specifying a env var



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)