You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@texera.apache.org by "aglinxinyuan (via GitHub)" <gi...@apache.org> on 2026/06/19 06:44:50 UTC
[I] Add unit test coverage for operator utility classes (OperatorDescriptorUtils, DistributedAggregation, URLFetchUtil) [texera]
aglinxinyuan opened a new issue, #5795:
URL: https://github.com/apache/texera/issues/5795
### Task Summary
Three small utility classes/objects under `common/workflow-operator/` have no `<srcClassName>Spec.scala`. They underpin numerical-partition behavior across worker counts (`OperatorDescriptorUtils`), the distributed-aggregate contract every aggregator obeys (`DistributedAggregation`), and the user-facing URL-fetch retry path (`URLFetchUtil`).
### Scope
| Source class | Lines | What's currently un-pinned |
| --- | --- | --- |
| `common/workflow-operator/.../util/OperatorDescriptorUtils.scala` | 52 | `equallyPartitionGoal(goal, workers)` sums to `goal`; ranges where `goal < workers`, `goal == workers`, `goal > workers`; remainder lands on the first `goal % workers` slots; `toImmutableMap` round-trip |
| `common/workflow-operator/.../aggregate/DistributedAggregation.scala` | 52 | case-class equality + per-field accessors; end-to-end `init`→`iterate`→`merge`→`finalAgg` worked example (running average) |
| `common/workflow-operator/.../source/fetcher/URLFetchUtil.scala` | 43 | success path returns `Some(stream)`; failure path retries N times and returns `None`; default `retries == 5` |
### Out of scope
No production-code changes. One `<srcClassName>Spec.scala` per source class.
### Task Type
- [x] Testing / QA
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add unit test coverage for operator utility classes (OperatorDescriptorUtils, DistributedAggregation, URLFetchUtil) [texera]
Posted by "aglinxinyuan (via GitHub)" <gi...@apache.org>.
aglinxinyuan closed issue #5795: Add unit test coverage for operator utility classes (OperatorDescriptorUtils, DistributedAggregation, URLFetchUtil)
URL: https://github.com/apache/texera/issues/5795
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Add unit test coverage for operator utility classes (OperatorDescriptorUtils, DistributedAggregation, URLFetchUtil) [texera]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #5795:
URL: https://github.com/apache/texera/issues/5795#issuecomment-4749163152
<!-- texera:template-compliance -->
👋 Thanks for opening this issue, @aglinxinyuan!
It looks like the issue description doesn't quite follow our template yet:
- This issue doesn't appear to use one of our templates (Bug, Feature, or Task). Please open it using a template so the required details are captured.
Filling out the template helps reviewers understand and triage your contribution faster. Please edit the description to complete it. This message will disappear automatically once the template is followed.
You can find the template prompts by editing the description, or see [CONTRIBUTING.md](https://github.com/apache/texera/blob/main/CONTRIBUTING.md) for the full contribution flow.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org