[GitHub] [incubator-druid] jihoonson commented on issue #3435: Consider including hadoop-aws in the lib folder

[GitBox <gi...@apache.org>]

jihoonson commented on issue #3435: Consider including hadoop-aws in the lib folder
URL: https://github.com/apache/incubator-druid/issues/3435#issuecomment-559194864
 
 
   > I think it'd also be good to include `hadoop-aws` by default to improve the user experience — especially since [the documentation for hadoop ingestion has examples that have paths in S3](https://druid.apache.org/docs/latest/ingestion/hadoop.html#inputspec).
   
   Particularly for the hadoop doc linked, I think the doc is wrong. The example should use `hdfs` instead of `s3n`.
   
   I don't see much benefit for including `hadoop-aws` in `lib`. Isn't it enough if we add a doc saying "you need hadoop-aws.jar in your classpath and here is how you can get it using the `pull-deps` tool"? We currently have no hadoop-related jars under `lib`. All of them are under `hadoop-dependencies` or `extensions/druid-hdfs-storage`. I guess it could be another option to include `hadoop-aws` in `druid-hdfs-storage`.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org