You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "czzmmc (via GitHub)" <gi...@apache.org> on 2023/04/21 09:23:18 UTC
[GitHub] [doris] czzmmc opened a new issue, #18904: [Feature] Support batch operation for Java UDAF to get better performance
czzmmc opened a new issue, #18904:
URL: https://github.com/apache/doris/issues/18904
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues.
### Description
Java UDAF can do a lot of things. Unlike Java UDF, we always want a stateful computation. Now we could do it by the new Java UDAF function, but usually get a really BAD performance. That is because we can only get a row once a time through add API. If we could fetch rows in batch, we may use the concurrency to get faster.
### Use case
_No response_
### Related issues
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] czzmmc commented on issue #18904: [Feature] Support batch operation for Java UDAF to get better performance
Posted by "czzmmc (via GitHub)" <gi...@apache.org>.
czzmmc commented on issue #18904:
URL: https://github.com/apache/doris/issues/18904#issuecomment-1639814085
> now, doris java udaf implement is batch call, like: for(int i=0;i<batch;++i){ invoke.add() } so user only implement the basic add function. Recently, performance improvements have been made to Java udf and udaf.
2.0 or 1.2.x ? Could u please mention the PR for me?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Feature] Support batch operation for Java UDAF to get better performance [doris]
Posted by "zhangstar333 (via GitHub)" <gi...@apache.org>.
zhangstar333 closed issue #18904: [Feature] Support batch operation for Java UDAF to get better performance
URL: https://github.com/apache/doris/issues/18904
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] zhangstar333 commented on issue #18904: [Feature] Support batch operation for Java UDAF to get better performance
Posted by "zhangstar333 (via GitHub)" <gi...@apache.org>.
zhangstar333 commented on issue #18904:
URL: https://github.com/apache/doris/issues/18904#issuecomment-1655192806
maybe in 2.0: https://github.com/apache/doris/pull/21388 https://github.com/apache/doris/pull/21713
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [doris] zhangstar333 commented on issue #18904: [Feature] Support batch operation for Java UDAF to get better performance
Posted by "zhangstar333 (via GitHub)" <gi...@apache.org>.
zhangstar333 commented on issue #18904:
URL: https://github.com/apache/doris/issues/18904#issuecomment-1639169280
now, doris java udaf implement is batch call, like:
for(int i=0;i<batch;++i){
invoke.add()
}
so user only implement the basic add function.
Recently, performance improvements have been made to Java udf and udaf.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org