[jira] [Commented] (AIRFLOW-1326) Contrib Spark Submit Hook should be able to produce arguments containing spaces.

["ASF subversion and git services (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AIRFLOW-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16083695#comment-16083695 ] 

ASF subversion and git services commented on AIRFLOW-1326:
----------------------------------------------------------

Commit f5ffb9deb51e896cdda8992c8b28102f7d650662 in incubator-airflow's branch refs/heads/master from [~ashb]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-airflow.git;h=f5ffb9d ]

[AIRFLOW-1326][[AIRFLOW-1326][AIRFLOW-1184] Don't split argument array -- it's already an array.[

Closes #2382 from ashb/spark-submit-operator-
preserve-spaces


> Contrib Spark Submit Hook should be able to produce arguments containing spaces.
> --------------------------------------------------------------------------------
>
>                 Key: AIRFLOW-1326
>                 URL: https://issues.apache.org/jira/browse/AIRFLOW-1326
>             Project: Apache Airflow
>          Issue Type: Bug
>          Components: contrib, hooks
>    Affects Versions: Airflow 2.0, Airflow 1.8
>            Reporter: Ash Berlin-Taylor
>            Assignee: Vianney FOUCAULT
>             Fix For: Airflow 2.0, Airflow 1.8
>
>
> AIRFLOW-1184 introduced a bug making it impossible to include an argument with an embedded space in the SparkSubmitOperator. (I believe the original bug report should have been closed as wontfix/not-a-bug as it was user error in how the SparkSubmitOperator is being called)
> i.e. the correct way to achieve what was wanted in the bug is like this:
> {code}
>             'application_args': [
>                 '-f', ' foo',
>                 '--bar', 'bar',
>                 '--start', '{{ macros.ds_add(ds, -1)}}',
>                 '--end', '{{ ds }}'
>             ]
> {code}
> This was possibly compounded as the tests were showing something that would never "work"



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)