You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Gera Shegalov (JIRA)" <ji...@apache.org> on 2018/08/24 02:45:00 UTC

[jira] [Created] (SPARK-25221) [DEPLOY] Consistent trailing whitespace treatment of conf values

Gera Shegalov created SPARK-25221:
-------------------------------------

             Summary: [DEPLOY] Consistent trailing whitespace treatment of conf values
                 Key: SPARK-25221
                 URL: https://issues.apache.org/jira/browse/SPARK-25221
             Project: Spark
          Issue Type: Bug
          Components: Deploy
    Affects Versions: 2.3.1
            Reporter: Gera Shegalov


When you use a custom line delimiter {{spark.hadoop.textinputformat.record.delimiter}} that has a leading or a trailing whitespace character it's only possible when specified via  {{--conf}} . Our pipeline consists of a highly customized generated jobs. Storing all the config in a properities file is not only better for readability but even necessary to avoid dealing with {{ARGS_MAX}} on different OS. Spark should uniformly avoid trimming conf values in both cases. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org