You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@kafka.apache.org by Israa Jaffery <is...@ataloud.com> on 2022/06/16 13:16:39 UTC

Redshift to GCP data modeling

Good Afternoon, 

There is a requirement wherein we need to select data from few tables in AWS redshift fit them into a data model and then transfer it via a datapipeline to GCP Bigquery.

We are planning to use Apache Kafka and Kafka Connectors as the data modelling/pipe-lining interface between redshift and bigquery.

Can you please let us know how we can transfer data from Redshift to Kafka as mostly we got information on how to transfer data from Kafka to Redshift.

Could you also please help us understand whether kafka would be the best option for this use case/problem statement.



Regards,



Israa Jaffery

Big Data Engineer

91-7030562393