You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@doris.apache.org by "Phadke, Trushna" <tr...@accenture.com.INVALID> on 2023/12/20 09:54:39 UTC
Re:[External]Need Technical support
Hello Mingyu Chen,
Yes, I tried applying Analyze function, but I am facing issues while analyzing, for me it is showing as :
Execution failed: Error Failed to execute SQL: java.lang.Exception: Unsupported statement type
[cid:image001.png@01DA3356.944EB0C0]
This did not work , so I tried to use the alteration method, provided on document, but it also did not work.
[cid:image002.png@01DA3356.944EB0C0]
I tried searching this error on internet, but not getting any helpful stuff.
Please, Guide us through, Also want to highlight another team mates issue, as she is not getting further response from support team
Please look at this as well.
As per our requirement we wanted to connect Doris DB to our Tableau desktop, unfortunately we are not able to get proper driver documentation for the same. Could we get important links and how to connect Tableau Desktop 2022.1.1 to Doris DB?
As per our requirement we wanted to connect Doris DB to our Tableau desktop, unfortunately we are not able to get proper driver documentation for the same. Could we get important links and how to connect Tableau Desktop 2022.1.1 to Doris DB?
I tried MYSQL odbc and jdbc connector, also tried Hive driver, but couldn't connect. Following error :
An error occurred while communicating with MySQL
Unable to connect to the server. Check that the server is running and that you have access privileges to the requested database.
Error Code: 298A3F01
[MySQL][ODBC 8.2(w) Driver]Lost connection to MySQL server at 'waiting for initial communication packet', system error: 10060
Unable to connect to the MySQL server "172.xx.x.xx". Check that the server is running and that you have access privileges to the requested database.
I used this link: https://backend.devrank.cn/traffic-information/7262678278132222013
Thanks, and regards,
Trushna Phadke.
From: Mingyu Chen <mo...@163.com>
Sent: Saturday, December 16, 2023 9:23 PM
To: dev@doris.apache.org
Cc: Misra, Kapildev <ka...@accenture.com>; Phadke, Trushna <tr...@accenture.com>
Subject: Re:RE: [External] Re:Need Technical support
Have you try to `analyze` the table before doing the query?
The error you encountered means the memory is not enought the run the query. There are several reasons:
1. Query plan is not optimized(eg, should use shuffle join instead of broadcast join), you can try `analyze` the table first.
2. If it still not work, may be you have to upgrade your machine's memory.
--
Best Regards
Mingyu Chen
Email:
morningman@apache.org<ma...@apache.org>
At 2023-12-16 23:46:11, "Annamaraja, Sai Krishna" <sa...@accenture.com.INVALID>> wrote:
>Hi Mingyu Chen,
>
>Please find the details below:
>
>
> 1. Doris version: 2.0.2
> 2. Cluster info: We have installed Doris on Azure virtual machine. Below are the details of it
>
>vCPU's: 4
>RAM: 16GB
>
>Storage: 1 TB Premium SSD LRS
>
>Please let me know if you need anything else.
>
>Thanks & Regards,
>Sai Krishna. A
>
>From: Mingyu Chen <mo...@163.com>>
>Sent: Tuesday, December 12, 2023 7:14 PM
>To: dev@doris.apache.org<ma...@doris.apache.org>
>Cc: Misra, Kapildev <ka...@accenture.com>>; Annamaraja, Sai Krishna <sa...@accenture.com>>
>Subject: [External] Re:Need Technical support
>
>CAUTION: External email. Be cautious with links and attachments.
>
>Please provide the followings so that we I can help you:
>
>1. Doris version
>2. You cluster info, cpu, mem, number of BE/FE nodes, etc.
>3. you can also try analyzing the table before query, see: https://doris.apache.org/docs/query-acceleration/statistics<https://urldefense.com/v3/__https:/doris.apache.org/docs/query-acceleration/statistics__;!!OrxsNty6D4my!_XqLeVqQs_zguXGqUh5MhYkuDrjiIUUzZjgsO88qXbvRcjC-2dj_SnhVhDSoM3CcVDMeiStJxC90kISF6UDakOMiDzQ$><https://urldefense.com/v3/__https:/doris.apache.org/docs/query-acceleration/statistics*3Chttps:/*urldefense.com/v3/__https:/doris.apache.org/docs/query-acceleration/statistics__;!!OrxsNty6D4my!_XqLeVqQs_zguXGqUh5MhYkuDrjiIUUzZjgsO88qXbvRcjC-2dj_SnhVhDSoM3CcVDMeiStJxC90kISF6UDakOMiDzQ$*3E__;JS8l!!OrxsNty6D4my!_66-LfZKOB3c0WEwuBpUQ48ystzMOxeBGL2SsmEGumr1uY7q9MQgjekL9qqU0kwFoNAYlaPy_fivRFmlMEUmjmYSwu0SnQ$>
>
>
>
>
>
>--
>Best Regards
>Mingyu Chen
>
>Email:
>morningman@apache.org<ma...@apache.org>>
>
>
>
>At 2023-12-12 18:39:11, "Phadke, Trushna" <tr...@accenture.com.INVALID>>> wrote:
>
>>Hello Team,
>
>>
>
>>Good afternoon. I am Trushna, and for our team, I am doing a POC on Apache Doris, we are kind of checking if it provides us expected performance.
>
>>During this POC , I pushed some of the data(141 GB) to Doris and was trying to execute one complex query, where I am getting below error:
>
>>
>
>>Execution failed: Error Failed to execute sql: java.sql.SQLException: errCode = 2, detailMessage = (172.18.2.11)[CANCELLED]Process has no memory available, cancel top memory usage query: query memory tracker <Query#Id=fbae8e88030b43f9-95bac64a06eb90bd> consumption 10.01 GB, backend 172.18.2.11 process memory used 12.11 GB exceed limit 12.45 GB or sys mem available 1.52 GB less than low water mark 1.56 GB. Execute again after enough memory, details see be.INFO.
>
>>
>
>>
>
>>On searching this, I got few suggestions to put some parameters in be.conf and fe.config file (parameters like be_mem_limit, be_low_water_mark), which I did try, but I am still stuck at same issue.
>
>>Can you guys help me to understand which config parameters can settle this issue, or any other method you suggest, Please guide me.
>
>>
>
>>
>
>>Thank you,
>
>>Trushna Phadke.
>
>>
>
>>
>
>>
>
>>
>
>>
>
>>________________________________
>
>>
>
>>This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received it in error, please notify the sender immediately and delete the original. Any other use of the e-mail by you is prohibited. Where allowed by local law, electronic communications with Accenture and its affiliates, including e-mail and instant messaging (including content), may be scanned by our systems for the purposes of information security, AI-powered support capabilities, and assessment of internal compliance with Accenture policy. Your privacy is important to us. Accenture uses your personal data only in compliance with data protection laws. For further information on how Accenture processes your personal data, please see our privacy statement at https://www.accenture.com/us-en/privacy-policy.
>
>>______________________________________________________________________________________
>
>>
>
>>http://www.accenture.com
RE: [External]Need Technical support
Posted by "Phadke, Trushna" <tr...@accenture.com.INVALID>.
Hello Mingyu Chen,
Good afternoon, hope you are doing good, just want to know, if you got a chance to look at the query below, I am stuck and really need some support to proceed with my POC.
Thanks, and regards,
Trushna Phadke.
From: Phadke, Trushna
Sent: Wednesday, December 20, 2023 3:25 PM
To: Mingyu Chen <mo...@163.com>; dev@doris.apache.org
Cc: Misra, Kapildev <ka...@accenture.com>; Annamaraja, Sai Krishna <sa...@accenture.com>; Chauhan, Neha <ne...@accenture.com>
Subject: Re:[External]Need Technical support
Hello Mingyu Chen,
Yes, I tried applying Analyze function, but I am facing issues while analyzing, for me it is showing as :
Execution failed: Error Failed to execute SQL: java.lang.Exception: Unsupported statement type
[cid:image001.png@01DA3413.0625BB50]
This did not work , so I tried to use the alteration method, provided on document, but it also did not work.
[cid:image002.png@01DA3413.0625BB50]
I tried searching this error on internet, but not getting any helpful stuff.
Please, Guide us through, Also want to highlight another team mates issue, as she is not getting further response from support team
Please look at this as well.
As per our requirement we wanted to connect Doris DB to our Tableau desktop, unfortunately we are not able to get proper driver documentation for the same. Could we get important links and how to connect Tableau Desktop 2022.1.1 to Doris DB?
As per our requirement we wanted to connect Doris DB to our Tableau desktop, unfortunately we are not able to get proper driver documentation for the same. Could we get important links and how to connect Tableau Desktop 2022.1.1 to Doris DB?
I tried MYSQL odbc and jdbc connector, also tried Hive driver, but couldn't connect. Following error :
An error occurred while communicating with MySQL
Unable to connect to the server. Check that the server is running and that you have access privileges to the requested database.
Error Code: 298A3F01
[MySQL][ODBC 8.2(w) Driver]Lost connection to MySQL server at 'waiting for initial communication packet', system error: 10060
Unable to connect to the MySQL server "172.xx.x.xx". Check that the server is running and that you have access privileges to the requested database.
I used this link: https://backend.devrank.cn/traffic-information/7262678278132222013
Thanks, and regards,
Trushna Phadke.
From: Mingyu Chen <mo...@163.com>>
Sent: Saturday, December 16, 2023 9:23 PM
To: dev@doris.apache.org<ma...@doris.apache.org>
Cc: Misra, Kapildev <ka...@accenture.com>>; Phadke, Trushna <tr...@accenture.com>>
Subject: Re:RE: [External] Re:Need Technical support
Have you try to `analyze` the table before doing the query?
The error you encountered means the memory is not enought the run the query. There are several reasons:
1. Query plan is not optimized(eg, should use shuffle join instead of broadcast join), you can try `analyze` the table first.
2. If it still not work, may be you have to upgrade your machine's memory.
--
Best Regards
Mingyu Chen
Email:
morningman@apache.org<ma...@apache.org>
At 2023-12-16 23:46:11, "Annamaraja, Sai Krishna" <sa...@accenture.com.INVALID>> wrote:
>Hi Mingyu Chen,
>
>Please find the details below:
>
>
> 1. Doris version: 2.0.2
> 2. Cluster info: We have installed Doris on Azure virtual machine. Below are the details of it
>
>vCPU's: 4
>RAM: 16GB
>
>Storage: 1 TB Premium SSD LRS
>
>Please let me know if you need anything else.
>
>Thanks & Regards,
>Sai Krishna. A
>
>From: Mingyu Chen <mo...@163.com>>
>Sent: Tuesday, December 12, 2023 7:14 PM
>To: dev@doris.apache.org<ma...@doris.apache.org>
>Cc: Misra, Kapildev <ka...@accenture.com>>; Annamaraja, Sai Krishna <sa...@accenture.com>>
>Subject: [External] Re:Need Technical support
>
>CAUTION: External email. Be cautious with links and attachments.
>
>Please provide the followings so that we I can help you:
>
>1. Doris version
>2. You cluster info, cpu, mem, number of BE/FE nodes, etc.
>3. you can also try analyzing the table before query, see: https://doris.apache.org/docs/query-acceleration/statistics<https://urldefense.com/v3/__https:/doris.apache.org/docs/query-acceleration/statistics__;!!OrxsNty6D4my!_XqLeVqQs_zguXGqUh5MhYkuDrjiIUUzZjgsO88qXbvRcjC-2dj_SnhVhDSoM3CcVDMeiStJxC90kISF6UDakOMiDzQ$><https://urldefense.com/v3/__https:/doris.apache.org/docs/query-acceleration/statistics*3Chttps:/*urldefense.com/v3/__https:/doris.apache.org/docs/query-acceleration/statistics__;!!OrxsNty6D4my!_XqLeVqQs_zguXGqUh5MhYkuDrjiIUUzZjgsO88qXbvRcjC-2dj_SnhVhDSoM3CcVDMeiStJxC90kISF6UDakOMiDzQ$*3E__;JS8l!!OrxsNty6D4my!_66-LfZKOB3c0WEwuBpUQ48ystzMOxeBGL2SsmEGumr1uY7q9MQgjekL9qqU0kwFoNAYlaPy_fivRFmlMEUmjmYSwu0SnQ$>
>
>
>
>
>
>--
>Best Regards
>Mingyu Chen
>
>Email:
>morningman@apache.org<ma...@apache.org>>
>
>
>
>At 2023-12-12 18:39:11, "Phadke, Trushna" <tr...@accenture.com.INVALID>>> wrote:
>
>>Hello Team,
>
>>
>
>>Good afternoon. I am Trushna, and for our team, I am doing a POC on Apache Doris, we are kind of checking if it provides us expected performance.
>
>>During this POC , I pushed some of the data(141 GB) to Doris and was trying to execute one complex query, where I am getting below error:
>
>>
>
>>Execution failed: Error Failed to execute sql: java.sql.SQLException: errCode = 2, detailMessage = (172.18.2.11)[CANCELLED]Process has no memory available, cancel top memory usage query: query memory tracker <Query#Id=fbae8e88030b43f9-95bac64a06eb90bd> consumption 10.01 GB, backend 172.18.2.11 process memory used 12.11 GB exceed limit 12.45 GB or sys mem available 1.52 GB less than low water mark 1.56 GB. Execute again after enough memory, details see be.INFO.
>
>>
>
>>
>
>>On searching this, I got few suggestions to put some parameters in be.conf and fe.config file (parameters like be_mem_limit, be_low_water_mark), which I did try, but I am still stuck at same issue.
>
>>Can you guys help me to understand which config parameters can settle this issue, or any other method you suggest, Please guide me.
>
>>
>
>>
>
>>Thank you,
>
>>Trushna Phadke.
>
>>
>
>>
>
>>
>
>>
>
>>
>
>>________________________________
>
>>
>
>>This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received it in error, please notify the sender immediately and delete the original. Any other use of the e-mail by you is prohibited. Where allowed by local law, electronic communications with Accenture and its affiliates, including e-mail and instant messaging (including content), may be scanned by our systems for the purposes of information security, AI-powered support capabilities, and assessment of internal compliance with Accenture policy. Your privacy is important to us. Accenture uses your personal data only in compliance with data protection laws. For further information on how Accenture processes your personal data, please see our privacy statement at https://www.accenture.com/us-en/privacy-policy.
>
>>______________________________________________________________________________________
>
>>
>
>>http://www.accenture.com
Re:Re:[External]Need Technical support
Posted by Mingyu Chen <mo...@163.com>.
Sorry that the FE webui does not support `analyze` statement.
U may need to simply use mysql command line to run the comand.
For Tableau, have you try MySQL 5.3.13 driver?
--
Best Regards
Mingyu Chen
Email:
morningman@apache.org
At 2023-12-20 17:54:39, "Phadke, Trushna" <tr...@accenture.com> wrote:
Hello Mingyu Chen,
Yes, I tried applying Analyze function, but I am facing issues while analyzing, for me it is showing as :
Execution failed: Error Failed to execute SQL: java.lang.Exception: Unsupported statement type
This did not work , so I tried to use the alteration method, provided on document, but it also did not work.
I tried searching this error on internet, but not getting any helpful stuff.
Please, Guide us through, Also want to highlight another team mates issue, as she is not getting further response from support team
Please look at this as well.
As per our requirement we wanted to connect Doris DB to our Tableau desktop, unfortunately we are not able to get proper driver documentation for the same. Could we get important links and how to connect Tableau Desktop 2022.1.1 to Doris DB?
As per our requirement we wanted to connect Doris DB to our Tableau desktop, unfortunately we are not able to get proper driver documentation for the same. Could we get important links and how to connect Tableau Desktop 2022.1.1 to Doris DB?
I tried MYSQL odbc and jdbc connector, also tried Hive driver, but couldn’t connect. Following error :
An error occurred while communicating with MySQL
Unable to connect to the server. Check that the server is running and that you have access privileges to the requested database.
Error Code: 298A3F01
[MySQL][ODBC 8.2(w) Driver]Lost connection to MySQL server at 'waiting for initial communication packet', system error: 10060
Unable to connect to the MySQL server "172.xx.x.xx". Check that the server is running and that you have access privileges to the requested database.
I used this link: https://backend.devrank.cn/traffic-information/7262678278132222013
Thanks, and regards,
Trushna Phadke.
From: Mingyu Chen <mo...@163.com>
Sent: Saturday, December 16, 2023 9:23 PM
To: dev@doris.apache.org
Cc: Misra, Kapildev <ka...@accenture.com>; Phadke, Trushna <tr...@accenture.com>
Subject: Re:RE: [External] Re:Need Technical support
Have you try to `analyze` the table before doing the query?
The error you encountered means the memory is not enought the run the query. There are several reasons:
1. Query plan is not optimized(eg, should use shuffle join instead of broadcast join), you can try `analyze` the table first.
2. If it still not work, may be you have to upgrade your machine's memory.
--
Best Regards
Mingyu Chen
Email:
morningman@apache.org
At 2023-12-16 23:46:11, "Annamaraja, Sai Krishna" <sa...@accenture.com.INVALID> wrote:
>Hi Mingyu Chen,
>
>Please find the details below:
>
>
> 1. Doris version: 2.0.2
> 2. Cluster info: We have installed Doris on Azure virtual machine. Below are the details of it
>
>vCPU's: 4
>RAM: 16GB
>
>Storage: 1 TB Premium SSD LRS
>
>Please let me know if you need anything else.
>
>Thanks & Regards,
>Sai Krishna. A
>
>From: Mingyu Chen <mo...@163.com>
>Sent: Tuesday, December 12, 2023 7:14 PM
>To: dev@doris.apache.org
>Cc: Misra, Kapildev <ka...@accenture.com>; Annamaraja, Sai Krishna <sa...@accenture.com>
>Subject: [External] Re:Need Technical support
>
>CAUTION: External email. Be cautious with links and attachments.
>
>Please provide the followings so that we I can help you:
>
>1. Doris version
>2. You cluster info, cpu, mem, number of BE/FE nodes, etc.
>3. you can also try analyzing the table before query, see: https://doris.apache.org/docs/query-acceleration/statistics<https://urldefense.com/v3/__https:/doris.apache.org/docs/query-acceleration/statistics__;!!OrxsNty6D4my!_XqLeVqQs_zguXGqUh5MhYkuDrjiIUUzZjgsO88qXbvRcjC-2dj_SnhVhDSoM3CcVDMeiStJxC90kISF6UDakOMiDzQ$>
>
>
>
>
>
>--
>Best Regards
>Mingyu Chen
>
>Email:
>morningman@apache.org<ma...@apache.org>
>
>
>
>At 2023-12-12 18:39:11, "Phadke, Trushna" <tr...@accenture.com.INVALID>> wrote:
>
>>Hello Team,
>
>>
>
>>Good afternoon. I am Trushna, and for our team, I am doing a POC on Apache Doris, we are kind of checking if it provides us expected performance.
>
>>During this POC , I pushed some of the data(141 GB) to Doris and was trying to execute one complex query, where I am getting below error:
>
>>
>
>>Execution failed: Error Failed to execute sql: java.sql.SQLException: errCode = 2, detailMessage = (172.18.2.11)[CANCELLED]Process has no memory available, cancel top memory usage query: query memory tracker <Query#Id=fbae8e88030b43f9-95bac64a06eb90bd> consumption 10.01 GB, backend 172.18.2.11 process memory used 12.11 GB exceed limit 12.45 GB or sys mem available 1.52 GB less than low water mark 1.56 GB. Execute again after enough memory, details see be.INFO.
>
>>
>
>>
>
>>On searching this, I got few suggestions to put some parameters in be.conf and fe.config file (parameters like be_mem_limit, be_low_water_mark), which I did try, but I am still stuck at same issue.
>
>>Can you guys help me to understand which config parameters can settle this issue, or any other method you suggest, Please guide me.
>
>>
>
>>
>
>>Thank you,
>
>>Trushna Phadke.
>
>>
>
>>
>
>>
>
>>
>
>>
>
>>________________________________
>
>>
>
>>This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received it in error, please notify the sender immediately and delete the original. Any other use of the e-mail by you is prohibited. Where allowed by local law, electronic communications with Accenture and its affiliates, including e-mail and instant messaging (including content), may be scanned by our systems for the purposes of information security, AI-powered support capabilities, and assessment of internal compliance with Accenture policy. Your privacy is important to us. Accenture uses your personal data only in compliance with data protection laws. For further information on how Accenture processes your personal data, please see our privacy statement at https://www.accenture.com/us-en/privacy-policy.
>
>>______________________________________________________________________________________
>
>>
>
>>http://www.accenture.com