You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Mihaly Toth (JIRA)" <ji...@apache.org> on 2018/03/18 06:01:00 UTC
[jira] [Commented] (SPARK-23729) Glob resolution breaks remote
naming of files/archives
[ https://issues.apache.org/jira/browse/SPARK-23729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16403876#comment-16403876 ]
Mihaly Toth commented on SPARK-23729:
-------------------------------------
Already working on this. Will submit a PR shortly.
> Glob resolution breaks remote naming of files/archives
> ------------------------------------------------------
>
> Key: SPARK-23729
> URL: https://issues.apache.org/jira/browse/SPARK-23729
> Project: Spark
> Issue Type: Bug
> Components: Spark Submit
> Affects Versions: 2.3.0
> Reporter: Mihaly Toth
> Priority: Major
>
> Given one uses {{spark-submit}} with either of the {{\-\-archives}} or the {{\-\-files}} parameters, in case the file name actually contains glob patterns, the rename part ({{...#nameAs}}) of the filename will eventually be ignored.
> Thinking over the resolution cases, if the resolution results in multiple files, it does not make sense to send all of them under the same remote name. So this should then result in an error.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org