You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/08/04 05:17:15 UTC

[GitHub] [hudi] garyli1019 commented on issue #3301: [SUPPORT] Deltastreamer cannot pattern match from AWS s3 files with wildcard

garyli1019 commented on issue #3301:
URL: https://github.com/apache/hudi/issues/3301#issuecomment-892370496


   hello @chb777777 , ParquetDFSSource doesn't support wildcard. You can define a root path and set up a sourceLimit to each run. Delta Streamer will load files based on their latest modification time. You could check the code of `ParquetDFSSource.fetchNextBatch()` for more details. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org