You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@texera.apache.org by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/06/13 17:43:56 UTC
[I] Move state-materialization e2e tests into amber-integration (drop sqlite SqlCatalog and the macOS-only diagnostic job) [texera]
Yicong-Huang opened a new issue, #5681:
URL: https://github.com/apache/texera/issues/5681
### Task Summary
Today the two `state-materialization` Python e2e tests run on a
separate macOS-only CI job (`pyamber-state-materialization-mac`,
[`.github/workflows/build.yml:742`](https://github.com/apache/texera/blob/main/.github/workflows/build.yml#L742)) that swaps in a sqlite-backed `SqlCatalog` so it
can run without postgres / minio / lakekeeper infra. That diverges
from prod, where every iceberg write goes through either a
postgres-backed JdbcCatalog or a REST catalog (Lakekeeper) on top of
MinIO/S3.
### Why it's a problem
1. `SqlCatalog` (sqlite) doesn't exercise the real prod catalog code
path — a regression in the postgres / REST plumbing is invisible
here.
2. The job is a duplicated diagnostic leg; the regression it was
meant to catch (cross-region state materialization on macOS) is
itself a test-environment artifact, not a prod concern (prod
runs on Linux).
### Proposal
| Before | After |
| --- | --- |
| `pyamber-state-materialization-mac` macOS job | (deleted) |
| `SqlCatalog` (sqlite) override in fixture | postgres-backed `JdbcCatalog` via `StorageConfig.initialize`, same pattern as `test_iceberg_document.py:45` |
| `pytest -sv test_state_materialization_e2e.py ...` direct | `@pytest.mark.integration` + picked up by `amber-integration` job's `pytest -m integration` step |
`amber-integration` ubuntu job already provisions postgres + iceberg
catalog DB + MinIO + Lakekeeper and runs `pytest -m integration` as
its last step ([`build.yml:300`](https://github.com/apache/texera/blob/main/.github/workflows/build.yml#L300)).
### Task Type
- [x] DevOps / Deployment / CI
- [x] Testing / QA
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Move state-materialization e2e tests into amber-integration (drop sqlite SqlCatalog and the macOS-only diagnostic job) [texera]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #5681:
URL: https://github.com/apache/texera/issues/5681#issuecomment-4699296651
<!-- texera:template-compliance -->
👋 Thanks for opening this issue, @Yicong-Huang!
It looks like the issue description doesn't quite follow our template yet:
- This issue doesn't appear to use one of our templates (Bug, Feature, or Task). Please open it using a template so the required details are captured.
Filling out the template helps reviewers understand and triage your contribution faster. Please edit the description to complete it. This message will disappear automatically once the template is followed.
You can find the template prompts by editing the description, or see [CONTRIBUTING.md](https://github.com/apache/texera/blob/main/CONTRIBUTING.md) for the full contribution flow.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Move state-materialization e2e tests into amber-integration (drop sqlite SqlCatalog and the macOS-only diagnostic job) [texera]
Posted by "Yicong-Huang (via GitHub)" <gi...@apache.org>.
Yicong-Huang closed issue #5681: Move state-materialization e2e tests into amber-integration (drop sqlite SqlCatalog and the macOS-only diagnostic job)
URL: https://github.com/apache/texera/issues/5681
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org