You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2018/12/11 13:40:36 UTC

[GitHub] KeiichiHirobe opened a new pull request #23288: Throws better exception when reading files that start with underscore

KeiichiHirobe opened a new pull request #23288: Throws better exception when reading files that start with underscore
URL: https://github.com/apache/spark/pull/23288
 
 
   ## What changes were proposed in this pull request?
   As the description in SPARK-26339, spark.read behavior is very confusing when reading files that start with underscore,  fix this by throwing exception which message is "Path does not exist".
   
   ## How was this patch tested?
   manual tests.
   Both of codes below throws exception which message is "Path does not exist".
   ```
   spark.read.csv("/home/forcia/work/spark/_test.csv")
   spark.read.schema("test STRING, number INT").csv("/home/forcia/work/spark/_test.csv")
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org