You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@uniffle.apache.org by "jerqi (via GitHub)" <gi...@apache.org> on 2023/05/17 05:25:31 UTC
[GitHub] [incubator-uniffle] jerqi opened a new issue, #889: [Improvement] Default value optimization for 0.8
jerqi opened a new issue, #889:
URL: https://github.com/apache/incubator-uniffle/issues/889
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](https://github.com/apache/incubator-uniffle/issues?q=is%3Aissue) and found no similar issues.
### What would you like to be improved?
We have developed features to improve the performance of Uniffle. But most of them are turned off by default. Now we will prefer to turn on some config options by default.
### How should we improve?
_No response_
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Improvement] Default value optimization for 0.8 [incubator-uniffle]
Posted by "jerqi (via GitHub)" <gi...@apache.org>.
jerqi closed issue #889: [Improvement] Default value optimization for 0.8
URL: https://github.com/apache/incubator-uniffle/issues/889
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For additional commands, e-mail: issues-help@uniffle.apache.org
[GitHub] [incubator-uniffle] leixm commented on issue #889: [Improvement] Default value optimization for 0.8
Posted by "leixm (via GitHub)" <gi...@apache.org>.
leixm commented on issue #889:
URL: https://github.com/apache/incubator-uniffle/issues/889#issuecomment-1647348115
> Maybe we can make these parameters as default value. @leixm These config options are related to you. Could you raise three pull requests to modify them one by one? (1)
>
> ```
> rss.server.single.buffer.flush.enabled true
> rss.server.single.buffer.flush.threshold 128M
> ```
>
> (2)
>
> ```
> rss.coordinator.select.partition.strategy CONTINUOUS
> ```
>
> (3)
>
> ```
> rss.server.max.concurrency.of.per-partition.write 30
> ```
Sure, i will raise PRs later.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] jerqi commented on issue #889: [Improvement] Default value optimization for 0.8
Posted by "jerqi (via GitHub)" <gi...@apache.org>.
jerqi commented on issue #889:
URL: https://github.com/apache/incubator-uniffle/issues/889#issuecomment-1689150255
> I will make the client compress type as ZSTD by default. cc @jerqi
It's ok for me if we have verified in the production environment.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For additional commands, e-mail: issues-help@uniffle.apache.org
[GitHub] [incubator-uniffle] zuston commented on issue #889: [Improvement] Default value optimization for 0.8
Posted by "zuston (via GitHub)" <gi...@apache.org>.
zuston commented on issue #889:
URL: https://github.com/apache/incubator-uniffle/issues/889#issuecomment-1689152935
> > I will make the client compress type as ZSTD by default. cc @jerqi
>
> It's ok for me if we have verified in the production environment.
ZSTD has been applied in our production for 1 year by default
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For additional commands, e-mail: issues-help@uniffle.apache.org
[GitHub] [incubator-uniffle] jerqi commented on issue #889: [Improvement] Default value optimization for 0.8
Posted by "jerqi (via GitHub)" <gi...@apache.org>.
jerqi commented on issue #889:
URL: https://github.com/apache/incubator-uniffle/issues/889#issuecomment-1689161790
> > > I will make the client compress type as ZSTD by default. cc @jerqi
> >
> >
> > It's ok for me if we have verified in the production environment.
>
> ZSTD has been applied in our production for 1 year by default
OK.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For additional commands, e-mail: issues-help@uniffle.apache.org
[GitHub] [incubator-uniffle] zuston commented on issue #889: [Improvement] Default value optimization for 0.8
Posted by "zuston (via GitHub)" <gi...@apache.org>.
zuston commented on issue #889:
URL: https://github.com/apache/incubator-uniffle/issues/889#issuecomment-1689148026
I will make the client compress type as ZSTD by default.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@uniffle.apache.org
For additional commands, e-mail: issues-help@uniffle.apache.org
[GitHub] [incubator-uniffle] jerqi commented on issue #889: [Improvement] Default value optimization for 0.8
Posted by "jerqi (via GitHub)" <gi...@apache.org>.
jerqi commented on issue #889:
URL: https://github.com/apache/incubator-uniffle/issues/889#issuecomment-1566023187
```
rss.server.single.buffer.flush.enabled true
rss.server.single.buffer.flush.threshold 128M
```
```
rss.coordinator.select.partition.strategy CONTINUOUS
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org