You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Marco Mistroni <mm...@gmail.com> on 2018/07/12 21:05:43 UTC

Reading multiple files in Spark / which pattern to use

hi all
 i have mutliple files stored in S3 in the following pattern

YYYY-MM-DD-securities.txt

I want to read multiple files at the same time..
I am attempting to use this pattern, for example

2016-01*securities.txt,2016-02*securities.txt,2016-03*securities.txt

But it does not seem to work....
Could anyone help out?

kind regards
 marco