You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Marco Mistroni <mm...@gmail.com> on 2018/07/12 21:05:43 UTC
Reading multiple files in Spark / which pattern to use
hi all
i have mutliple files stored in S3 in the following pattern
YYYY-MM-DD-securities.txt
I want to read multiple files at the same time..
I am attempting to use this pattern, for example
2016-01*securities.txt,2016-02*securities.txt,2016-03*securities.txt
But it does not seem to work....
Could anyone help out?
kind regards
marco