You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@graphar.apache.org by "acezen (via GitHub)" <gi...@apache.org> on 2024/08/01 02:27:28 UTC
Re: [I] feat(scala): Support S3 reading/writing [incubator-graphar]
acezen commented on issue #570:
URL: https://github.com/apache/incubator-graphar/issues/570#issuecomment-2261828802
> > So I think we can add some guide to document to tell the user that if they want to use s3, they need to add hadoop-aws by themselves?
>
> What do you think about reference to the documentation of Apache Spark itself? Because otherwise it may be confusing. Most of spark distributions (like Databricks Runtime, Microsoft Fabric, EMR, Cludera Spark, etc.) already contains all the dependencies needed for integration with the corresponding cloud provider. This dependencies are often proprietary and adding an OSS `hadoop-aws` may tend to unpredictable behaviour.
>
> [This section](https://hadoop.apache.org/docs/current/hadoop-aws/tools/hadoop-aws/index.html) of Hadoop Documentation is very detailed.
Make sense to me. I can open a PR and add the document as reference.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@graphar.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@graphar.apache.org
For additional commands, e-mail: commits-help@graphar.apache.org