[GitHub] [incubator-druid] jnaous commented on issue #3435: Consider including hadoop-aws in the lib folder

[GitBox <gi...@apache.org>]

jnaous commented on issue #3435: Consider including hadoop-aws in the lib folder
URL: https://github.com/apache/incubator-druid/issues/3435#issuecomment-559197615
 
 
   +1 for adding libs by default. People always seem to stumble on missing
   libs. It would be great to remove setup steps from documentation and making
   more things "work OOB" as much as possible.
   
   On Wed, Nov 27, 2019 at 10:03 AM Jihoon Son <no...@github.com>
   wrote:
   
   > I think it'd also be good to include hadoop-aws by default to improve the
   > user experience — especially since the documentation for hadoop ingestion
   > has examples that have paths in S3
   > <https://druid.apache.org/docs/latest/ingestion/hadoop.html#inputspec>.
   >
   > Particularly for the hadoop doc linked, I think the doc is wrong. The
   > example should use hdfs instead of s3n.
   >
   > I don't see much benefit for including hadoop-aws in lib. Isn't it enough
   > if we add a doc saying "you need hadoop-aws.jar in your classpath and here
   > is how you can get it using the pull-deps tool"? We currently have no
   > hadoop-related jars under lib. All of them are under hadoop-dependencies
   > or extensions/druid-hdfs-storage. I guess it could be another option to
   > include hadoop-aws in druid-hdfs-storage.
   >
   > —
   > You are receiving this because you are subscribed to this thread.
   > Reply to this email directly, view it on GitHub
   > <https://github.com/apache/incubator-druid/issues/3435?email_source=notifications&email_token=AAPSYCWRRBTPOK3VVIJN2UTQV2ZA5A5CNFSM4COZRP22YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEFKKF4A#issuecomment-559194864>,
   > or unsubscribe
   > <https://github.com/notifications/unsubscribe-auth/AAPSYCSE6YBUY2NFYBPWPGLQV2ZA5ANCNFSM4COZRP2Q>
   > .
   >
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org