You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2020/02/26 21:39:10 UTC

[GitHub] [druid] jihoonson commented on issue #9411: S3 InputSource issue when using prefix mode if a directory contains _SUCCESS files

jihoonson commented on issue #9411: S3 InputSource issue when using prefix mode if a directory contains  _SUCCESS files
URL: https://github.com/apache/druid/issues/9411#issuecomment-591657701
 
 
   Hi @sascha-coenen, I think the second `inputSource` with the `_SUCCESS` file is created for a subtask. In 0.17, the parallel task lists all objects starting with the given prefixes and creates subtasks to process each object. Unfortunately, there is no way to filter out unwanted objects for s3 input source now.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org