Re: Supplying jar stored at S3 to flink to run the job in kubernetes

[Yang Wang <wa...@apache.org>]

Do you build your own flink-kubernetes-operator image with the flink-s3-fs
plugin bundled[1]?

[1].
https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-release-1.3/docs/custom-resource/overview/#flinksessionjob-spec-overview

Best,
Yang

Weihua Hu <hu...@gmail.com> 于2023年1月17日周二 10:47写道：

> Hi, Rahul
>
> User support and questions should be sent to the user mailing list (
> user@flink.apache.org)
>
> You can resend the issue to the user mailing list with a detailed error
> log.
>
> Best,
> Weihua
>
>
> On Mon, Jan 16, 2023 at 11:18 PM rahul sahoo <ra...@gmail.com>
> wrote:
>
> > I have been following the examples mentioned here:
> > flink-kubernetes-operator_examples
> > <https://github.com/apache/flink-kubernetes-operator/tree/main/examples
> >.
> > I'm testing this on the local minikube. I have deployed minio for s3 and
> > flink operator.
> >
> > I have my application jar in s3(using minio for this). I have deployed
> the
> > flink session deployment in minikube and want to submit the job as
> > mentioned in basic-session-deployment-and-job.yaml
> > <
> >
> https://github.com/apache/flink-kubernetes-operator/blob/main/examples/basic-session-deployment-and-job.yaml
> > >
> >
> > I want to replace the `https://` to `s3a://` in this line
> > <
> >
> https://github.com/apache/flink-kubernetes-operator/blob/92034fa912f39f5c8bd57632295c7ca85801f33a/examples/basic-session-deployment-and-job.yaml#L43
> > >.
> > The final URL should look like
> > `s3a://local-bkt/flink-examples-streaming_2.12-1.16.0.jar`. I'm using
> > flink_2.12-1.16.0 with s3 plugin in docker image.
> >
> > Can anyone help me to solve this?
> >
> > Thank You,
> > Rahul Sahoo
> >
>