You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by ant burton <ap...@gmail.com> on 2017/08/13 22:52:51 UTC
Flink Data Streaming to S3
Hello,
Has anybody been able to write to S3 when using the data streaming API ?
I’m having this problem https://stackoverflow.com/questions/45655850/flink-s3-write-fails-unable-to-load-aws-credentials-from-any-provider-in-the-cha <https://stackoverflow.com/questions/45655850/flink-s3-write-fails-unable-to-load-aws-credentials-from-any-provider-in-the-cha>
Thanks
Re: Flink Data Streaming to S3
Posted by ant burton <ap...@gmail.com>.
Thanks Vinay,
After jar xf jar-file the JAR file, and then find . -name "*.xml", I can only locate ./core-default.xml, updating this file does not resolve the issue, am I missing something?
Should the core-site.xml be placed in the root of the jar or else where?
:-)
> On 14 Aug 2017, at 07:32, vinay patil <vi...@gmail.com> wrote:
>
> Hi,
>
> Yes, I am able to write to S3 using DataStream API.
>
> I have answered you the approach on SO
>
> Regards,
> Vinay Patil
>
> On Mon, Aug 14, 2017 at 4:21 AM, ant burton [via Apache Flink User Mailing List archive.] <[hidden email] <x-msg://17/user/SendEmail.jtp?type=node&node=14877&i=0>> wrote:
> Hello,
>
> Has anybody been able to write to S3 when using the data streaming API ?
>
> I’m having this problem https://stackoverflow.com/questions/45655850/flink-s3-write-fails-unable-to-load-aws-credentials-from-any-provider-in-the-cha <https://stackoverflow.com/questions/45655850/flink-s3-write-fails-unable-to-load-aws-credentials-from-any-provider-in-the-cha>
>
> Thanks
>
>
> If you reply to this email, your message will be added to the discussion below:
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Data-Streaming-to-S3-tp14871.html <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Data-Streaming-to-S3-tp14871.html>
> To start a new topic under Apache Flink User Mailing List archive., email [hidden email] <x-msg://17/user/SendEmail.jtp?type=node&node=14877&i=1>
> To unsubscribe from Apache Flink User Mailing List archive., click here <applewebdata://249309A5-9B7C-4587-8599-6E91A6EB868C>.
> NAML <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>
> View this message in context: Re: Flink Data Streaming to S3 <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Data-Streaming-to-S3-tp14871p14877.html>
> Sent from the Apache Flink User Mailing List archive. mailing list archive <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/> at Nabble.com.
Re: Flink Data Streaming to S3
Posted by vinay patil <vi...@gmail.com>.
Hi,
Yes, I am able to write to S3 using DataStream API.
I have answered you the approach on SO
Regards,
Vinay Patil
On Mon, Aug 14, 2017 at 4:21 AM, ant burton [via Apache Flink User Mailing
List archive.] <ml...@n4.nabble.com> wrote:
> Hello,
>
> Has anybody been able to write to S3 when using the data streaming API ?
>
> I’m having this problem https://stackoverflow.
> com/questions/45655850/flink-s3-write-fails-unable-to-load-
> aws-credentials-from-any-provider-in-the-cha
>
> Thanks
>
>
> ------------------------------
> If you reply to this email, your message will be added to the discussion
> below:
> http://apache-flink-user-mailing-list-archive.2336050.
> n4.nabble.com/Flink-Data-Streaming-to-S3-tp14871.html
> To start a new topic under Apache Flink User Mailing List archive., email
> ml+s2336050n1h83@n4.nabble.com
> To unsubscribe from Apache Flink User Mailing List archive., click here
> <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=1&code=dmluYXkxOC5wYXRpbEBnbWFpbC5jb218MXwxODExMDE2NjAx>
> .
> NAML
> <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>
--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Flink-Data-Streaming-to-S3-tp14871p14877.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.