You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2022/09/29 13:53:51 UTC
[GitHub] [incubator-seatunnel] melin opened a new issue, #1082: [Feature]Support flow limit
melin opened a new issue, #1082:
URL: https://github.com/apache/incubator-seatunnel/issues/1082
### Search before asking
- [X] I had searched in the [feature](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.
### Description
Reading and writing the rds database needs to limit traffic to avoid affecting database performance
### Usage Scenario
_No response_
### Related issues
_No response_
### Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] melin closed issue #1082: [Feature]Support flow limit
Posted by GitBox <gi...@apache.org>.
melin closed issue #1082: [Feature]Support flow limit
URL: https://github.com/apache/incubator-seatunnel/issues/1082
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] EricJoy2048 commented on issue #1082: [Feature]Support rate limit
Posted by GitBox <gi...@apache.org>.
EricJoy2048 commented on issue #1082:
URL: https://github.com/apache/incubator-seatunnel/issues/1082#issuecomment-1263155432
> > Can you describe this requirement in detail? Sprak or Flink both provide corresponding parameters, is this what you are talking about?
>
> For example, when synchronizing data from mysql into hive, I hope to control the speed of reading mysql data, and read up to 100 rows per second to avoid affecting business operations.
>
> The write data speed also needs to be controllable.
>
> ratelimit is an important requirement for data synchronization tools
Yes, I think we need speed controllable too. Do you have some ideas?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] melin commented on issue #1082: [Feature]Support flow limit
Posted by GitBox <gi...@apache.org>.
melin commented on issue #1082:
URL: https://github.com/apache/incubator-seatunnel/issues/1082#issuecomment-1262325035
> Can you describe this requirement in detail? Sprak or Flink both provide corresponding parameters, is this what you are talking about?
For example, when synchronizing data from mysql into hive, I hope to control the speed of reading mysql data, and read up to 100 rows per second to avoid affecting business operations.
The write data speed also needs to be controllable.
ratelimit is an important requirement for data synchronization tools
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] stale[bot] commented on issue #1082: [Feature]Support flow limit
Posted by GitBox <gi...@apache.org>.
stale[bot] commented on issue #1082:
URL: https://github.com/apache/incubator-seatunnel/issues/1082#issuecomment-1101921671
This has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] hailin0 commented on issue #1082: [Feature]Support rate limit
Posted by "hailin0 (via GitHub)" <gi...@apache.org>.
hailin0 commented on issue #1082:
URL: https://github.com/apache/seatunnel/issues/1082#issuecomment-1663632801
```
env {
read_limit.rows_per_second = xxx
read_limit.bytes_per_second = xxx
}
source {
...
}
sink {
...
}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] PainAshura commented on issue #1082: [Feature]Support rate limit
Posted by "PainAshura (via GitHub)" <gi...@apache.org>.
PainAshura commented on issue #1082:
URL: https://github.com/apache/seatunnel/issues/1082#issuecomment-1670520957
@hailin0 hey! I am curious if this new feature is being developed or is it being discussed. Or even not going to consider it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org