You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2022/04/01 12:20:42 UTC
[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #9320: [Bug] [task sql] execute a sql with dynamic table name
github-actions[bot] commented on issue #9320:
URL: https://github.com/apache/dolphinscheduler/issues/9320#issuecomment-1085829598
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar issues.
### What happened
Hi. I have a problem when I submit a SQL task. My SQL have a dynamic table name. Because it's a partitioned table by postgresql.
The task definition like below:
![image](https://user-images.githubusercontent.com/12369169/161258187-13c7eaa7-b407-4f3b-89f4-4fbdec22d64a.png)
The declare SQL is:
```sql
WITH
r00 AS (
SELECT coalesce(rb_build_agg(cast(id as int)), rb_build('{}')) AS id_bitmap
FROM ads.t_dmp_test_user
WHERE (id not in (1,2,3) AND (part_day BETWEEN TO_CHAR(CURRENT_DATE-3000, 'YYYY-MM-DD') AND '2022-03-30' OR jkx_userid is not null))
)
INSERT INTO ads.t_dmp_test_tag_${abc} (tag_name,tag_id,tag_value,bit_list,etl_time,part_day)
SELECT '付费用户',123,'七日内付费用户',r00.id_bitmap,CURRENT_TIMESTAMP,TO_CHAR(CURRENT_DATE, 'YYYY-MM-DD') FROM r00
ON CONFLICT(tag_name, tag_value, part_day)
DO UPDATE SET (tag_name,tag_id,tag_value,bit_list,etl_time,part_day)=ROW(excluded.*)
```
But I got a error when the task executed. The error info like below:
![image](https://user-images.githubusercontent.com/12369169/161259409-96634b17-a8af-45a3-8f18-e69690c316d0.png)
The error message:
```
[ERROR] 2022-04-01 19:27:05.672 [TaskLogInfo- - [taskAppId=TASK-5037179531040_7-267-584]] - execute sql error: ERROR: relation "ads.t_dmp_test_tag_$1" does not exist
Position: 269
[ERROR] 2022-04-01 19:27:05.672 [TaskLogInfo- - [taskAppId=TASK-5037179531040_7-267-584]] - sql task error: org.postgresql.util.PSQLException: ERROR: relation "ads.t_dmp_test_tag_$1" does not exist
Position: 269
```
### What you expected to happen
I hope SQL task can support execute a sql with dynamic table name.
### How to reproduce
It can distinguish the different SQL part, such as table name, where conditions etc.
### Anything else
_No response_
### Version
2.0.3
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org