You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Jasmin Redzepovic <ja...@superbet.com> on 2022/04/19 20:34:02 UTC
Re: [EXT] Vertica jdbc sink error
Hi Martin,
Thanks for your answer. Regarding my contribution, I will for sure check the contributing guide and get familiar with Flink source code. I hope it will end up well and I will be able to write that functionality.
Best regards,
Jasmin
On 19.04.2022., at 09:39, Martijn Visser <ma...@apache.org>> wrote:
[CAUTION] This email comes from an external organization. Do not click links or open attachments unless you recognize the sender and know the content is safe.
Hi Jasmin,
Vertica is not implemented as a JDBC dialect, which is a requirement for Flink to support this. You can find an overview of the currently supported JDBC dialects in the documentation [1]. It would be interesting if you could contribute support for Vertica towards Flink.
Best regards,
Martijn Visser
https://twitter.com/MartijnVisser82<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Ftwitter.com%2FMartijnVisser82&data=04%7C01%7Cjasmin.redzepovic%40superbet.com%7C227d3cb6db6d41742f2908da21d7c33b%7C2c8cda8f751e479886805761f91d4e40%7C0%7C0%7C637859507830792773%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=nhEDB631iDDAXw4HvqnxKQSgqI4gV7IqQhAOTqBC8MM%3D&reserved=0>
https://github.com/MartijnVisser<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FMartijnVisser&data=04%7C01%7Cjasmin.redzepovic%40superbet.com%7C227d3cb6db6d41742f2908da21d7c33b%7C2c8cda8f751e479886805761f91d4e40%7C0%7C0%7C637859507830792773%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=5FFd115rYYtFKCdoqHqKr4yExrE1nwQwyV6XcbeAPss%3D&reserved=0>
[1] https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/table/jdbc/<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fnightlies.apache.org%2Fflink%2Fflink-docs-master%2Fdocs%2Fconnectors%2Ftable%2Fjdbc%2F&data=04%7C01%7Cjasmin.redzepovic%40superbet.com%7C227d3cb6db6d41742f2908da21d7c33b%7C2c8cda8f751e479886805761f91d4e40%7C0%7C0%7C637859507830792773%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000&sdata=LWwhWfSGjWuJfjsosDq1DTxavr48Lus8PD6%2BTeqR1KI%3D&reserved=0>
On Fri, 15 Apr 2022 at 14:27, Jasmin Redzepovic <ja...@superbet.com>> wrote:
Hello Flink community,
I am getting this error when writing data to Vertica table:
Exception in thread "main" org.apache.flink.table.api.ValidationException: Unable to create a sink for writing table 'default_catalog.default_database.VerticaSink’.
...
Caused by: java.lang.IllegalStateException: Cannot handle such jdbc url: jdbc:vertica://<host>:5433/sbtverticadb01
This is the code for creating sink table and inserting into it:
tEnv.executeSql("""
CREATE TABLE VerticaSink (
TICKET_ID STRING,
TICKET_CODE STRING,
BUSINESS_MARKET_CODE STRING,
BUSINESS_LINE_CODE STRING,
PRIMARY KEY (TICKET_ID) NOT ENFORCED
) WITH (
'connector' = 'jdbc',
'url' = 'jdbc:vertica://<host>:5433/sbtverticadb01',
'table-name' = 'SBX_DE.FLINK_SINK2',
'username' = ‘username',
'password' = ‘password'
)
"”")
tEnv.executeSql("""
INSERT INTO VerticaSink
SELECT TICKET_ID, TICKET_CODE, BUSINESS_MARKET_CODE, BUSINESS_LINE_CODE from Transformation2
"”")
I downloaded jdbc driver for Vertica and added it into ./lib folder.
Does anyone have idea what could it be? I googled the error, but didn’t find anything helpful.
Thanks and best regards,
Jasmin
This email is confidential and intended solely for the use of the individual or entity to whom it is addressed. If you received this e-mail by mistake, please notify the sender immediately by e-mail and delete this e-mail from your system. Please be informed that if you are not the intended recipient, you should not disseminate, distribute, disclose, copy or use this e-mail in any way, the act of dissemination, distribution, disclosure, copying or taking any action in reliance on the contents of this information being strictly prohibited. This e-mail is sent by a Superbet Group company. Any views expressed by the sender of this email are not necessarily those of Superbet Group. Please note that computer viruses can be transmitted by email. You are advised to check this email and any attachments for the presence of viruses. Superbet Group cannot accept any responsibility for any viruses transmitted by this email and/or any attachments.
Re: [EXT] Vertica jdbc sink error
Posted by Jasmin Redzepovic <ja...@superbet.com>.
Hi Martin,
here is a Jira ticket I created: https://issues.apache.org/jira/browse/FLINK-27429
I guess you now assign it to me, right? :)
Best Regards,
Jasmin
On 19.04.2022., at 22:34, Jasmin Redzepovic <ja...@superbet.com>> wrote:
Hi Martin,
Thanks for your answer. Regarding my contribution, I will for sure check the contributing guide and get familiar with Flink source code. I hope it will end up well and I will be able to write that functionality.
Best regards,
Jasmin
On 19.04.2022., at 09:39, Martijn Visser <ma...@apache.org>> wrote:
[CAUTION] This email comes from an external organization. Do not click links or open attachments unless you recognize the sender and know the content is safe.
Hi Jasmin,
Vertica is not implemented as a JDBC dialect, which is a requirement for Flink to support this. You can find an overview of the currently supported JDBC dialects in the documentation [1]. It would be interesting if you could contribute support for Vertica towards Flink.
Best regards,
Martijn Visser
https://twitter.com/MartijnVisser82<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Ftwitter.com%2FMartijnVisser82&data=05%7C01%7Cjasmin.redzepovic%40superbet.com%7C9bbeddf0f079433f4d5408da2243f8f7%7C2c8cda8f751e479886805761f91d4e40%7C0%7C0%7C637859972589226518%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=kRVn%2B5VI%2Bsq%2FZamDfQqejkvJ5LLtHQolyEhGW9bmfUA%3D&reserved=0>
https://github.com/MartijnVisser<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FMartijnVisser&data=05%7C01%7Cjasmin.redzepovic%40superbet.com%7C9bbeddf0f079433f4d5408da2243f8f7%7C2c8cda8f751e479886805761f91d4e40%7C0%7C0%7C637859972589226518%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=%2FZ%2FTtv38Ed9S7McZIxW3t7pjnZJUe8DadOHibjQolRs%3D&reserved=0>
[1] https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/table/jdbc/<https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fnightlies.apache.org%2Fflink%2Fflink-docs-master%2Fdocs%2Fconnectors%2Ftable%2Fjdbc%2F&data=05%7C01%7Cjasmin.redzepovic%40superbet.com%7C9bbeddf0f079433f4d5408da2243f8f7%7C2c8cda8f751e479886805761f91d4e40%7C0%7C0%7C637859972589226518%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=6drIfPyqldOlLLuOm9k90LnqCuK6KIpGqm2QaRrnl4E%3D&reserved=0>
On Fri, 15 Apr 2022 at 14:27, Jasmin Redzepovic <ja...@superbet.com>> wrote:
Hello Flink community,
I am getting this error when writing data to Vertica table:
Exception in thread "main" org.apache.flink.table.api.ValidationException: Unable to create a sink for writing table 'default_catalog.default_database.VerticaSink’.
...
Caused by: java.lang.IllegalStateException: Cannot handle such jdbc url: jdbc:vertica://<host>:5433/sbtverticadb01
This is the code for creating sink table and inserting into it:
tEnv.executeSql("""
CREATE TABLE VerticaSink (
TICKET_ID STRING,
TICKET_CODE STRING,
BUSINESS_MARKET_CODE STRING,
BUSINESS_LINE_CODE STRING,
PRIMARY KEY (TICKET_ID) NOT ENFORCED
) WITH (
'connector' = 'jdbc',
'url' = 'jdbc:vertica://<host>:5433/sbtverticadb01',
'table-name' = 'SBX_DE.FLINK_SINK2',
'username' = ‘username',
'password' = ‘password'
)
"”")
tEnv.executeSql("""
INSERT INTO VerticaSink
SELECT TICKET_ID, TICKET_CODE, BUSINESS_MARKET_CODE, BUSINESS_LINE_CODE from Transformation2
"”")
I downloaded jdbc driver for Vertica and added it into ./lib folder.
Does anyone have idea what could it be? I googled the error, but didn’t find anything helpful.
Thanks and best regards,
Jasmin
This email is confidential and intended solely for the use of the individual or entity to whom it is addressed. If you received this e-mail by mistake, please notify the sender immediately by e-mail and delete this e-mail from your system. Please be informed that if you are not the intended recipient, you should not disseminate, distribute, disclose, copy or use this e-mail in any way, the act of dissemination, distribution, disclosure, copying or taking any action in reliance on the contents of this information being strictly prohibited. This e-mail is sent by a Superbet Group company. Any views expressed by the sender of this email are not necessarily those of Superbet Group. Please note that computer viruses can be transmitted by email. You are advised to check this email and any attachments for the presence of viruses. Superbet Group cannot accept any responsibility for any viruses transmitted by this email and/or any attachments.