You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2018/08/22 16:13:00 UTC
[jira] [Work logged] (BEAM-5062) Add ability to configure
S3ClientOptions
[ https://issues.apache.org/jira/browse/BEAM-5062?focusedWorklogId=137003&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-137003 ]
ASF GitHub Bot logged work on BEAM-5062:
----------------------------------------
Author: ASF GitHub Bot
Created on: 22/Aug/18 16:12
Start Date: 22/Aug/18 16:12
Worklog Time Spent: 10m
Work Description: yuppie-flu commented on issue #6122: [BEAM-5062] Add ability to provide custom S3ClientOptions
URL: https://github.com/apache/beam/pull/6122#issuecomment-415088991
Hey @iemejia
I thought that a cleaner way would be to expose `S3ClientOptions` to client, not the whole `AmazonS3ClientBuilder`. You can check in this updated PR. However, it's impossible to pass `S3ClientOptions` to the builder as a whole object, so the PR includes "hack" method to pass them one-by-one.
I created an improvement issues for `aws-skd-java` library: https://github.com/aws/aws-sdk-java/issues/1736
When it's done, the hack can be removed.
What do you think?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 137003)
Time Spent: 2h (was: 1h 50m)
> Add ability to configure S3ClientOptions
> ----------------------------------------
>
> Key: BEAM-5062
> URL: https://issues.apache.org/jira/browse/BEAM-5062
> Project: Beam
> Issue Type: Improvement
> Components: io-java-aws
> Reporter: Kirill Kozlov
> Assignee: Kirill Kozlov
> Priority: Minor
> Time Spent: 2h
> Remaining Estimate: 0h
>
> It would be very useful to have an ability to configure [S3ClientOptions|https://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/services/s3/S3ClientOptions.html] for Apache Beam jobs.
> For example, there are some implementations of S3, that does not supportĀ virtual-hosted-style URLs for buckets, only path-style. Currently it's impossible to enable path style access for amazon s3 client, which is used by an apache-beam job.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)