You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hugegraph.apache.org by "imbajin (via GitHub)" <gi...@apache.org> on 2026/10/22 20:08:19 UTC

[PR] fix: preserve task and query failure causes [hugegraph]

imbajin opened a new pull request, #3394:
URL: https://github.com/apache/hugegraph/pull/3394

   ## Purpose of the PR
   
   Follow-up to the first lifecycle cleanup: [org #329](https://github.com/hugegraph/hugegraph/pull/329) / [ASF #3393](https://github.com/apache/hugegraph/pull/3393). This branch includes that prerequisite while it is awaiting merge; the additional changes below are the second cleanup round.
   
   Keep task and query failures visible to callers, while preserving existing API signatures, retry budgets, negative task-ID rules and stored data formats.
   
   ## Main Changes
   
   | Trigger | Before | After |
   | --- | --- | --- |
   | Interrupt a producer waiting on a full queue | An input can be skipped while submission returns normally | Submission fails with the interrupt retained and cleanup still runs |
   | Concurrent ephemeral job scheduling | Unsynchronized ID allocation can reuse an ID | Atomic allocation preserves the existing negative range and wraparound |
   | A PD unary call exhausts its retries | A null response hides the RPC failure behind a later NPE | Callers receive a PDException with the RPC method and original cause |
   | ORDER BY fails or a converted iterator closes | Sorting errors are swallowed and adapters can lose resource ownership | Errors reach the query failure path; owned sources close once and close failures remain visible |
   
   Also retain causes when wrapping checked task errors and preserve scheduler failures without exception messages. Type conversion keeps stable iterator probes, direct `next()` calls and completion-supplier retry behavior.
   
   ## Verifying these changes
   
   - [ ] Trivial rework / code cleanup without any test coverage. (No Need)
   - [x] Existing consumer, traversal, scheduler, PD transport and aggregate-query lifecycle regressions pass.
   - [x] Added regression coverage for interrupted submission, task-ID allocation, missing error messages, PD retry/error contracts, converted-iterator cleanup and ORDER BY RPC failure cleanup.
   
   Validated with Java 17: repository formatting and full clean compile, followed by focused Server, PD and Store tests against the updated artifacts. Independent review found no remaining blocking issue. Multi-node cluster validation is not included.
   
   ## Does this PR potentially affect the following parts?
   
   - [ ] Dependencies
   - [ ] Modify configurations
   - [ ] The public API
   - [x] Other affects: failure reporting, cancellation and iterator cleanup
   - [ ] Nope
   
   ## Documentation Status
   
   - [ ] `Doc - TODO`: required documentation is pending; complete it before merging.
   - [x] `Doc - Done`: documentation is included here.
   - [ ] `Doc - No Need`: no user-visible documentation is affected.
   
   Documentation: [storage lifecycle contracts](https://github.com/hugegraph/hugegraph/blob/fix/java17-cleanup-round2/docs/storage-lifecycle.md). No website configuration or API-reference changes are required.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For additional commands, e-mail: issues-help@hugegraph.apache.org


Re: [PR] fix: preserve task and query failure causes [hugegraph]

Posted by "imbajin (via GitHub)" <gi...@apache.org>.
imbajin merged PR #3394:
URL: https://github.com/apache/hugegraph/pull/3394


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For additional commands, e-mail: issues-help@hugegraph.apache.org


Re: [PR] fix: preserve task and query failure causes [hugegraph]

Posted by "codecov[bot] (via GitHub)" <gi...@apache.org>.
codecov[bot] commented on PR #3394:
URL: https://github.com/apache/hugegraph/pull/3394#issuecomment-6350362985

   ## [Codecov](https://app.codecov.io/gh/apache/hugegraph/pull/3394?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
   :x: Patch coverage is `44.11765%` with `57 lines` in your changes missing coverage. Please review.
   :white_check_mark: Project coverage is 56.49%. Comparing base ([`c2ec570`](https://app.codecov.io/gh/apache/hugegraph/commit/c2ec5704332fc1102ad277d6aae6658d65c73601?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`ceb2b91`](https://app.codecov.io/gh/apache/hugegraph/commit/ceb2b91dfef7de974ed069dc1ad28d8d909bcab0?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
   :warning: Report is 12 commits behind head on master.
   
   | [Files with missing lines](https://app.codecov.io/gh/apache/hugegraph/pull/3394?dropdown=coverage&src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Patch % | Lines |
   |---|---|---|
   | [...che/hugegraph/job/algorithm/AbstractAlgorithm.java](https://app.codecov.io/gh/apache/hugegraph/pull/3394?src=pr&el=tree&filepath=hugegraph-server%2Fhugegraph-core%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhugegraph%2Fjob%2Falgorithm%2FAbstractAlgorithm.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVnZWdyYXBoLXNlcnZlci9odWdlZ3JhcGgtY29yZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvaHVnZWdyYXBoL2pvYi9hbGdvcml0aG0vQWJzdHJhY3RBbGdvcml0aG0uamF2YQ==) | 0.00% | [20 Missing :warning: ](https://app.codecov.io/gh/apache/hugegraph/pull/3394?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   | [.../org/apache/hugegraph/job/algorithm/Consumers.java](https://app.codecov.io/gh/apache/hugegraph/pull/3394?src=pr&el=tree&filepath=hugegraph-server%2Fhugegraph-core%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhugegraph%2Fjob%2Falgorithm%2FConsumers.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVnZWdyYXBoLXNlcnZlci9odWdlZ3JhcGgtY29yZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvaHVnZWdyYXBoL2pvYi9hbGdvcml0aG0vQ29uc3VtZXJzLmphdmE=) | 0.00% | [15 Missing :warning: ](https://app.codecov.io/gh/apache/hugegraph/pull/3394?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   | [...n/java/org/apache/hugegraph/task/TaskCallable.java](https://app.codecov.io/gh/apache/hugegraph/pull/3394?src=pr&el=tree&filepath=hugegraph-server%2Fhugegraph-core%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhugegraph%2Ftask%2FTaskCallable.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVnZWdyYXBoLXNlcnZlci9odWdlZ3JhcGgtY29yZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvaHVnZWdyYXBoL3Rhc2svVGFza0NhbGxhYmxlLmphdmE=) | 30.00% | [7 Missing :warning: ](https://app.codecov.io/gh/apache/hugegraph/pull/3394?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   | [...a/org/apache/hugegraph/store/util/SortShuffle.java](https://app.codecov.io/gh/apache/hugegraph/pull/3394?src=pr&el=tree&filepath=hugegraph-store%2Fhg-store-core%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhugegraph%2Fstore%2Futil%2FSortShuffle.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVnZWdyYXBoLXN0b3JlL2hnLXN0b3JlLWNvcmUvc3JjL21haW4vamF2YS9vcmcvYXBhY2hlL2h1Z2VncmFwaC9zdG9yZS91dGlsL1NvcnRTaHVmZmxlLmphdmE=) | 81.57% | [5 Missing and 2 partials :warning: ](https://app.codecov.io/gh/apache/hugegraph/pull/3394?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   | [...hugegraph/job/algorithm/comm/LouvainTraverser.java](https://app.codecov.io/gh/apache/hugegraph/pull/3394?src=pr&el=tree&filepath=hugegraph-server%2Fhugegraph-core%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhugegraph%2Fjob%2Falgorithm%2Fcomm%2FLouvainTraverser.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVnZWdyYXBoLXNlcnZlci9odWdlZ3JhcGgtY29yZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvaHVnZWdyYXBoL2pvYi9hbGdvcml0aG0vY29tbS9Mb3V2YWluVHJhdmVyc2VyLmphdmE=) | 0.00% | [6 Missing :warning: ](https://app.codecov.io/gh/apache/hugegraph/pull/3394?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   | [...main/java/org/apache/hugegraph/util/Consumers.java](https://app.codecov.io/gh/apache/hugegraph/pull/3394?src=pr&el=tree&filepath=hugegraph-server%2Fhugegraph-core%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fhugegraph%2Futil%2FConsumers.java&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache#diff-aHVnZWdyYXBoLXNlcnZlci9odWdlZ3JhcGgtY29yZS9zcmMvbWFpbi9qYXZhL29yZy9hcGFjaGUvaHVnZWdyYXBoL3V0aWwvQ29uc3VtZXJzLmphdmE=) | 0.00% | [2 Missing :warning: ](https://app.codecov.io/gh/apache/hugegraph/pull/3394?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   
   <details><summary>Additional details and impacted files</summary>
   
   
   
   ```diff
   @@             Coverage Diff              @@
   ##             master    #3394      +/-   ##
   ============================================
   + Coverage     55.93%   56.49%   +0.55%     
   - Complexity     2277     2757     +480     
   ============================================
     Files           774      776       +2     
     Lines         68534    68887     +353     
     Branches       9333     9423      +90     
   ============================================
   + Hits          38334    38917     +583     
   + Misses        26634    26376     -258     
   - Partials       3566     3594      +28     
   ```
   
   | [Flag](https://app.codecov.io/gh/apache/hugegraph/pull/3394/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | *Carryforward flag |
   |---|---|---|---|
   | [commons](https://app.codecov.io/gh/apache/hugegraph/pull/3394/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `96.37% <ø> (ø)` | | |
   | [hstore](https://app.codecov.io/gh/apache/hugegraph/pull/3394/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `36.06% <5.66%> (+0.25%)` | :arrow_up: | Carriedforward from [437893b](https://app.codecov.io/gh/apache/hugegraph/commit/437893bd3017f3411ca1fccff6e4d1f43908d996?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   | [pd](https://app.codecov.io/gh/apache/hugegraph/pull/3394/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `50.29% <100.00%> (+1.11%)` | :arrow_up: | Carriedforward from [437893b](https://app.codecov.io/gh/apache/hugegraph/commit/437893bd3017f3411ca1fccff6e4d1f43908d996?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   | [server_hbase](https://app.codecov.io/gh/apache/hugegraph/pull/3394/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `41.93% <ø> (+0.03%)` | :arrow_up: | Carriedforward from [437893b](https://app.codecov.io/gh/apache/hugegraph/commit/437893bd3017f3411ca1fccff6e4d1f43908d996?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   | [server_memory](https://app.codecov.io/gh/apache/hugegraph/pull/3394/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `54.40% <ø> (+0.07%)` | :arrow_up: | Carriedforward from [437893b](https://app.codecov.io/gh/apache/hugegraph/commit/437893bd3017f3411ca1fccff6e4d1f43908d996?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   | [server_rocksdb](https://app.codecov.io/gh/apache/hugegraph/pull/3394/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `42.71% <5.66%> (+0.36%)` | :arrow_up: | Carriedforward from [437893b](https://app.codecov.io/gh/apache/hugegraph/commit/437893bd3017f3411ca1fccff6e4d1f43908d996?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   | [store](https://app.codecov.io/gh/apache/hugegraph/pull/3394/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.02% <81.63%> (+1.08%)` | :arrow_up: | Carriedforward from [437893b](https://app.codecov.io/gh/apache/hugegraph/commit/437893bd3017f3411ca1fccff6e4d1f43908d996?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
   
   *This pull request uses carry forward flags. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) to find out more.
   </details>
   
   [:umbrella: View full report in Codecov by Harness](https://app.codecov.io/gh/apache/hugegraph/pull/3394?dropdown=coverage&src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache).   
   :loudspeaker: Have feedback on the report? [Share it here](https://about.codecov.io/codecov-pr-comment-feedback/?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache).
   <details><summary> :rocket: New features to boost your workflow: </summary>
   
   - :snowflake: [Test Analytics](https://docs.codecov.com/docs/test-analytics): Detect flaky tests, report on failures, and find test suite problems.
   </details>


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@hugegraph.apache.org
For additional commands, e-mail: issues-help@hugegraph.apache.org