You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by GitBox <gi...@apache.org> on 2020/03/20 06:39:47 UTC
[GitHub] [flink-statefun] tzulitai opened a new pull request #64:
[FLINK-16124] YAML-ized Kinesis ingress / egresses
tzulitai opened a new pull request #64: [FLINK-16124] YAML-ized Kinesis ingress / egresses
URL: https://github.com/apache/flink-statefun/pull/64
This is a follow-up to #61, adding the YAML-ized Kinesis ingress / egresses.
---
### Usage
- Ingress:
```
ingress:
meta:
type: statefun.kinesis.io/routable-protobuf-ingress
id: com.mycomp.foo/bar
spec:
awsRegion:
type: specific
id: us-west-2
awsCredentials:
type: basic
accessKeyId: my_access_key_id
secretAccessKey: my_secret_access_key
startupPosition:
type: earliest
streams:
- stream: stream-1
typeUrl: com.googleapis/com.mycomp.foo.MessageA
targets:
- com.mycomp.foo/function-1
- com.mycomp.foo/function-2
- stream: topic-2
typeUrl: com.googleapis/com.mycomp.foo.MessageB
targets:
- com.mycomp.foo/function-2
clientConfigProperties:
- SocketTimeout: 9999
- MaxConnections: 15
```
- Egress:
```
egress:
meta:
type: statefun.kinesis.io/generic-egress
id: com.mycomp.foo/bar
spec:
awsRegion:
type: custom-endpoint
endpoint: https://localhost:4567
id: us-west-1
awsCredentials:
type: profile
profileName: john-doe
profilePath: /path/to/profile/config
maxOutstandingRecords: 9999
clientConfigProperties:
- ThreadingModel: POOLED
- ThreadPoolSize: 10
```
Note: by default, `awsRegion`, `awsCredentials`, `startupPosition`, `maxOutstandingRecords`, and `clientConfigProperties` do not need to be specified.
---
### Changelog
Important changes are:
- 54cf5a2 Implement runtime classes / providers for the routable protobuf Kinesis ingress
- 001561f Binds the `AutoRoutableProtobufRouter` for the routable Kinesis ingress in the `JsonModule`
- ad56622 Binds the new provider for the routable Kinesis ingress
- ba46048 Implements runtime classes / providers for the generic Kinesis egress
- 094dc6c Binds the new provider for the generic Kinesis egress
All other commits are preliminary changes for the above.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [flink-statefun] tzulitai commented on issue #64: [FLINK-16124]
YAML-ized Kinesis ingress / egresses
Posted by GitBox <gi...@apache.org>.
tzulitai commented on issue #64: [FLINK-16124] YAML-ized Kinesis ingress / egresses
URL: https://github.com/apache/flink-statefun/pull/64#issuecomment-602158474
Thanks for the review @igalshilman, merging ...
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
[GitHub] [flink-statefun] tzulitai closed pull request #64: [FLINK-16124]
YAML-ized Kinesis ingress / egresses
Posted by GitBox <gi...@apache.org>.
tzulitai closed pull request #64: [FLINK-16124] YAML-ized Kinesis ingress / egresses
URL: https://github.com/apache/flink-statefun/pull/64
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services