[GitHub] [incubator-doris] Henry2SS opened a new issue #7202: [Sql Block] add a new rule to block sql by num of partition/tablet/cardinality will be scanned.

[GitBox <gi...@apache.org>]

Henry2SS opened a new issue #7202:
URL: https://github.com/apache/incubator-doris/issues/7202


   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues.
   
   
   ### Description
   
   According to the design of the sql block rule, the query that matches the certain PATTERN or sql_HASH will be blocked.
   But there are still lots of big query can be executed.
   
   I think it is a good idea that block the big sql by nums of partition/tablet/cardinality that will be scanned. For exmaple, we can set a rule for a user:
   `CREATE SQL_BLOCK_RULE test_rule PROPERTIES("partition"="31", "tablet"="496", "cardinality"="1000000000")`
   `SET PROPERTY [FOR 'test_user'] 'sql_block_rules' = 'test_rule'`
   When a query's num of partition/tablet/cardinality is larger than the quota set in the block rules, it will throw an exception and return before executing.
   
   
   ### Use case
   
   Big sql appears when:
   1.  a new sql which is handwritten and different from the ones online.
   2. already added partition key, but in some scenarios, such as using concat to process partition key, it didn't hit partition and did full table scan.
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org

[GitHub] [incubator-doris] morningman closed issue #7202: [Sql Block] add a new rule to block sql by num of partition/tablet/cardinality will be scanned.

[GitBox <gi...@apache.org>]

morningman closed issue #7202:
URL: https://github.com/apache/incubator-doris/issues/7202


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org