[jira] [Commented] (FLINK-19667) Add integration with AWS Glue

["Robert Metzger (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLINK-19667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17217625#comment-17217625 ] 

Robert Metzger commented on FLINK-19667:
----------------------------------------

Thanks a lot for your request. In general, I'm careful adding new integrations for (at least to me) relatively unknown services into Flink, because of the maintenance overhead this brings to the community.
But since AWS is offering a hosted service for Flink, I believe that in particular those users would benefit from such an integration.

I would like to understand the exact changes needed a little bit better:
Would this integration be comparable to {{flink-avro-confluent-registry}}?
Which datatypes would you support?
How would we test the integration? (Is there something like kinesalite or Google Cloud PubSub Emulator?)


> Add integration with AWS Glue
> -----------------------------
>
>                 Key: FLINK-19667
>                 URL: https://issues.apache.org/jira/browse/FLINK-19667
>             Project: Flink
>          Issue Type: New Feature
>          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
>    Affects Versions: 1.11.0, 1.11.1, 1.11.2, 1.11.3
>            Reporter: Mohit Paliwal
>            Priority: Major
>              Labels: AWS, Glue
>             Fix For: 1.12.0
>
>
> AWS Glue is releasing new features for the AWS Glue Data Catalog. This request is to add a new format to launch an integration for Apache Flink with AWS Glue Data Catalog



--
This message was sent by Atlassian Jira
(v8.3.4#803005)