You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by "Katz, David L via user" <us...@flink.apache.org> on 2023/03/03 16:25:10 UTC

aws zeppelin glue table connector

Hi-

Hoping someone can give me more understanding and a sense of timing flink leveraging glue tables.  Specifically I would like to leverage a glue table data source via an AWS hosted Zeppelin notebook (instead of referencing a kinesis data stream or s3 bucket directly).  Additionally I will need to have this work for a lake formation glue database (i.e. underlying data is in a different aws account).  Believe this JIRA may cover it but not sure all of that is in scope:
https://issues.apache.org/jira/browse/FLINK-29549

Questions that come to mind:

  1.  Is the full data flow I outlined above expected to be supported with that JIRA?
  2.  Do we know when the connector will be released?
  3.  Do we have a general sense of when AWS would make that version of flink will be available as a flink runtime?

Thanks in advance!
-Dave


David L Katz (he/him/his) why?<https://sites.jpmchase.com/sites/companyhome/about%20us/diversity/pages/language,-inclusion-%26-gender-pronous.aspx> | Executive Director | Macro Technology | 545 Washington Blvd, Floor 4 | Jersey City, NJ 07310


This message is confidential and subject to terms at: https://www.jpmorgan.com/emaildisclaimer including on confidential, privileged or legal entity information, malicious content and monitoring of electronic messages. If you are not the intended recipient, please delete this message and notify the sender immediately. Any unauthorized use is strictly prohibited.

RE: aws zeppelin glue table connector

Posted by "Katz, David L via user" <us...@flink.apache.org>.

Hi-

Don't see a response for this so taking one last stab.  Any reply would be greatly appreciated.

Thanks,
-Dave

David L Katz (he/him/his) why?<https://sites.jpmchase.com/sites/companyhome/about%20us/diversity/pages/language,-inclusion-%26-gender-pronous.aspx> | Executive Director | Macro Technology | 545 Washington Blvd, Floor 4 | Jersey City, NJ 07310

From: Katz, David L (CIB Tech, USA)
Sent: Friday, March 03, 2023 11:25 AM
To: user <us...@flink.apache.org>
Subject: aws zeppelin glue table connector

Hi-

Hoping someone can give me more understanding and a sense of timing flink leveraging glue tables.  Specifically I would like to leverage a glue table data source via an AWS hosted Zeppelin notebook (instead of referencing a kinesis data stream or s3 bucket directly).  Additionally I will need to have this work for a lake formation glue database (i.e. underlying data is in a different aws account).  Believe this JIRA may cover it but not sure all of that is in scope:
https://issues.apache.org/jira/browse/FLINK-29549

Questions that come to mind:

  1.  Is the full data flow I outlined above expected to be supported with that JIRA?
  2.  Do we know when the connector will be released?
  3.  Do we have a general sense of when AWS would make that version of flink will be available as a flink runtime?

Thanks in advance!
-Dave


David L Katz (he/him/his) why?<https://sites.jpmchase.com/sites/companyhome/about%20us/diversity/pages/language,-inclusion-%26-gender-pronous.aspx> | Executive Director | Macro Technology | 545 Washington Blvd, Floor 4 | Jersey City, NJ 07310


This message is confidential and subject to terms at: https://www.jpmorgan.com/emaildisclaimer including on confidential, privileged or legal entity information, malicious content and monitoring of electronic messages. If you are not the intended recipient, please delete this message and notify the sender immediately. Any unauthorized use is strictly prohibited.