You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@texera.apache.org by "bobbai00 (via GitHub)" <gi...@apache.org> on 2026/05/30 15:36:14 UTC
[PR] feat: route computing-unit metadata over HTTP, off Postgres [texera]
bobbai00 opened a new pull request, #5298:
URL: https://github.com/apache/texera/pull/5298
### What changes were proposed in this PR?
The computing unit (which runs user-defined functions) no longer needs direct Postgres access. Execution-metadata operations route to the Dashboard Service (`TexeraWebApplication`) via a new `/api/internal/execution-metadata/*` API (`InternalExecutionMetadataResource`) and an HTTP client (`RemoteExecutionMetadata`); dataset-path resolution routes to file-service's new `GET /api/dataset/resolve` (`RemoteDatasetResolver` + a one-line dispatch in `FileResolver`). Routing engages when `SqlServer` is uninitialized (the CU) and the forwarded user JWT is present; `ComputingUnitMaster` skips `SqlServer.initConnection` and DB cleanup when `EXECUTION_METADATA_REMOTE=true`. No behavior change with the flag off — the Dashboard Service keeps the direct-DB path. Also adds `SqlServer.isInitialized` and the new env-var names.
### Any related issues, documentation, discussions?
Part of #5011
### How was this PR tested?
Unit tests for both HTTP clients (`RemoteDatasetResolverSpec`, `RemoteExecutionMetadataSpec`) using in-process HTTP servers — positive, 404→None, and error-status paths. Manually end-to-end: launched the full stack with the CU master in `EXECUTION_METADATA_REMOTE=true` mode (no `STORAGE_JDBC_*`; verified no Hikari/`SqlServer` init) against a Lakekeeper REST catalog; the IMDB example workflows (Movies, Iris) and workflow 2568 ran to completion with every execution-metadata and dataset-resolution call served over HTTP (confirmed in the Dashboard Service / file-service request logs).
### Was this PR authored or co-authored using generative AI tooling?
Generated-by: Claude Opus 4.8 (1M context)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat: route computing-unit metadata over HTTP, off Postgres [texera]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed pull request #5298: feat: route computing-unit metadata over HTTP, off Postgres
URL: https://github.com/apache/texera/pull/5298
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat: route computing-unit metadata over HTTP, off Postgres [texera]
Posted by "codecov-commenter (via GitHub)" <gi...@apache.org>.
codecov-commenter commented on PR #5298:
URL: https://github.com/apache/texera/pull/5298#issuecomment-4583285615
## [Codecov](https://app.codecov.io/gh/apache/texera/pull/5298?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) Report
:white_check_mark: All modified and coverable lines are covered by tests.
:white_check_mark: Project coverage is 49.16%. Comparing base ([`59f776c`](https://app.codecov.io/gh/apache/texera/commit/59f776c853d3b18a6e385ed9b27b7d4aafc835de?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)) to head ([`a6c34ba`](https://app.codecov.io/gh/apache/texera/commit/a6c34ba2a79f26dbaffde6d1136e387c758fc53b?dropdown=coverage&el=desc&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache)).
:warning: Report is 4 commits behind head on main.
<details><summary>Additional details and impacted files</summary>
```diff
@@ Coverage Diff @@
## main #5298 +/- ##
============================================
- Coverage 49.17% 49.16% -0.01%
Complexity 2386 2386
============================================
Files 1051 1051
Lines 40350 40320 -30
Branches 4279 4278 -1
============================================
- Hits 19841 19825 -16
+ Misses 19352 19338 -14
Partials 1157 1157
```
| [Flag](https://app.codecov.io/gh/apache/texera/pull/5298/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | Coverage Δ | | *Carryforward flag |
|---|---|---|---|
| [access-control-service](https://app.codecov.io/gh/apache/texera/pull/5298/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `41.89% <ø> (ø)` | | |
| [agent-service](https://app.codecov.io/gh/apache/texera/pull/5298/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `33.76% <ø> (ø)` | | Carriedforward from [59f776c](https://app.codecov.io/gh/apache/texera/commit/59f776c853d3b18a6e385ed9b27b7d4aafc835de?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [amber](https://app.codecov.io/gh/apache/texera/pull/5298/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `51.68% <ø> (-0.01%)` | :arrow_down: | Carriedforward from [59f776c](https://app.codecov.io/gh/apache/texera/commit/59f776c853d3b18a6e385ed9b27b7d4aafc835de?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [computing-unit-managing-service](https://app.codecov.io/gh/apache/texera/pull/5298/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `0.00% <ø> (ø)` | | Carriedforward from [59f776c](https://app.codecov.io/gh/apache/texera/commit/59f776c853d3b18a6e385ed9b27b7d4aafc835de?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [config-service](https://app.codecov.io/gh/apache/texera/pull/5298/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `0.00% <ø> (ø)` | | Carriedforward from [59f776c](https://app.codecov.io/gh/apache/texera/commit/59f776c853d3b18a6e385ed9b27b7d4aafc835de?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [file-service](https://app.codecov.io/gh/apache/texera/pull/5298/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `38.42% <ø> (ø)` | | Carriedforward from [59f776c](https://app.codecov.io/gh/apache/texera/commit/59f776c853d3b18a6e385ed9b27b7d4aafc835de?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [frontend](https://app.codecov.io/gh/apache/texera/pull/5298/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `41.07% <ø> (ø)` | | Carriedforward from [59f776c](https://app.codecov.io/gh/apache/texera/commit/59f776c853d3b18a6e385ed9b27b7d4aafc835de?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [python](https://app.codecov.io/gh/apache/texera/pull/5298/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `90.79% <ø> (ø)` | | Carriedforward from [59f776c](https://app.codecov.io/gh/apache/texera/commit/59f776c853d3b18a6e385ed9b27b7d4aafc835de?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
| [workflow-compiling-service](https://app.codecov.io/gh/apache/texera/pull/5298/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) | `56.81% <ø> (ø)` | | Carriedforward from [59f776c](https://app.codecov.io/gh/apache/texera/commit/59f776c853d3b18a6e385ed9b27b7d4aafc835de?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) |
*This pull request uses carry forward flags. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache) to find out more.
</details>
[:umbrella: View full report in Codecov by Sentry](https://app.codecov.io/gh/apache/texera/pull/5298?dropdown=coverage&src=pr&el=continue&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache).
:loudspeaker: Have feedback on the report? [Share it here](https://about.codecov.io/codecov-pr-comment-feedback/?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=apache).
<details><summary> :rocket: New features to boost your workflow: </summary>
- :package: [JS Bundle Analysis](https://docs.codecov.com/docs/javascript-bundle-analysis): Save yourself from yourself by tracking and limiting bundle sizes in JS merges.
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat: route computing-unit metadata over HTTP, off Postgres [texera]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #5298:
URL: https://github.com/apache/texera/pull/5298#issuecomment-5754280749
This pull request has been automatically marked as **stale** because it has
not had any activity for 30 days. It will be closed in **7 days** if no
further activity occurs.
If this PR is still relevant, please:
- Push new commits or rebase onto the latest `main`, or
- Comment with a status update, or
- Address any open review feedback.
To exempt this PR from auto-close, a maintainer can add the `pinned` label.
Thank you for your contribution to Apache Texera (incubating)!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] feat: route computing-unit metadata over HTTP, off Postgres [texera]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on PR #5298:
URL: https://github.com/apache/texera/pull/5298#issuecomment-5861801241
This pull request has been automatically closed due to 37 days of inactivity.
If you would like to continue this work, please re-open the PR or open a new
one referencing this. Thank you for your contribution.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org