You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Wenchen Fan (Jira)" <ji...@apache.org> on 2020/09/08 14:18:00 UTC
[jira] [Updated] (SPARK-32815) Fix LibSVM data source loading error
on file paths with glob metacharacters
[ https://issues.apache.org/jira/browse/SPARK-32815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wenchen Fan updated SPARK-32815:
--------------------------------
Fix Version/s: 3.0.2
2.4.8
> Fix LibSVM data source loading error on file paths with glob metacharacters
> ---------------------------------------------------------------------------
>
> Key: SPARK-32815
> URL: https://issues.apache.org/jira/browse/SPARK-32815
> Project: Spark
> Issue Type: Bug
> Components: MLlib
> Affects Versions: 3.1.0
> Reporter: Maxim Gekk
> Assignee: Maxim Gekk
> Priority: Major
> Fix For: 2.4.8, 3.1.0, 3.0.2
>
>
> SPARK-32810 fixed a long standing bug in a few Spark built-in data sources that fails to read files whose names contain glob metacharacters, such as [, ], \{, }, etc.
> CSV and JSON data source on the Spark side were affected. We've also noticed that the LibSVM data source had the same code pattern that leads to the bug, so the fix https://github.com/apache/spark/pull/29659 included a fix for that data source as well, but it did not include a test for the LibSVM data source.
> This ticket tracks adding a test case for LibSVM, similar to the ones for CSV/JSON, to verify whether or not the fix works as intended.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org