You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Robert Cullen <ci...@gmail.com> on 2021/08/18 14:20:20 UTC

Setting S3 parameters in a K8 jobmanager deployment

I have a kubernetes jobmanager deployment that requires parameters be
passed as command line rather than retrieving values from the flink-config
map. Is there a way to do this?

apiVersion: apps/v1
kind: Deployment
metadata:
  name: flink-jobmanager
spec:
  replicas: 1 # Set the value to greater than 1 to start standby JobManagers
  selector:
    matchLabels:
      app: flink
      component: jobmanager
  template:
    metadata:
      labels:
        app: flink
        component: jobmanager
    spec:
      containers:
      - name: jobmanager
        image: apache/flink:1.13.0-scala_2.11
        args: ["jobmanager", "-Ds3.endpoint=https://192.173.0.0:9000",
"-Ds3.access-key=key", "Ds3.secret-key=secret"]
        ports

Robert Cullen
240-475-4490

Re: Setting S3 parameters in a K8 jobmanager deployment

Posted by Yang Wang <da...@gmail.com>.
I am afraid jobmanager.sh[1] could not parse the "-D" correctly now.

[1].
https://github.com/apache/flink/blob/master/flink-dist/src/main/flink-bin/bin/jobmanager.sh


Best,
Yang

Robert Cullen <ci...@gmail.com> 于2021年8月18日周三 下午10:21写道:

> I have a kubernetes jobmanager deployment that requires parameters be
> passed as command line rather than retrieving values from the flink-config
> map. Is there a way to do this?
>
> apiVersion: apps/v1
> kind: Deployment
> metadata:
>   name: flink-jobmanager
> spec:
>   replicas: 1 # Set the value to greater than 1 to start standby JobManagers
>   selector:
>     matchLabels:
>       app: flink
>       component: jobmanager
>   template:
>     metadata:
>       labels:
>         app: flink
>         component: jobmanager
>     spec:
>       containers:
>       - name: jobmanager
>         image: apache/flink:1.13.0-scala_2.11
>         args: ["jobmanager", "-Ds3.endpoint=https://192.173.0.0:9000", "-Ds3.access-key=key", "Ds3.secret-key=secret"]
>         ports
>
> Robert Cullen
> 240-475-4490
>