You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jobs@airflow.apache.org by GitBox <gi...@apache.org> on 2026/06/04 21:41:06 UTC
[GH] (airflow/aip99-example-aiptracker): Workflow run "Tests (AMD)" failed!
The GitHub Actions job "Tests (AMD)" on airflow.git/aip99-example-aiptracker has failed.
Run started by GitHub user vikramkoka (triggered by vikramkoka).
Head commit for run:
ce2f14b3684b3d0c4cdbeafa558bca327eb25306 / Vikram Koka <vi...@astronomer.io>
Improve AIP progress tracker example DAG to produce accurate, evidence-backed results
The example DAG was producing hallucinated output -- fabricated completion
percentages, invented blockers, and missed shipped work -- because the
evidence pipeline was too thin and the prompts too permissive.
Key changes:
- Add AIP registry with Confluence page IDs, GitHub search aliases, and
codebase directory paths for multi-strategy evidence gathering
- Fetch GitHub file tree (Git Trees API) for codebase-level evidence
- Replace flat 3000-char spec truncation with section-aware parsing
- Replace completion_pct/blockers Pydantic model with per-deliverable
DeliverableStatus (name, status, evidence, confidence)
- Add grounding rules to analysis/synthesis/validation system prompts
- Add three-layer quality pipeline: AI validation (LLMOperator) identifies
ungrounded claims, deterministic apply_validation task does mechanical
find-and-replace, human reviews the corrected report
- Add arithmetic validation that cross-checks X/Y fractions against
structured analysis data (catches validator-introduced errors)
- Set temperature=0 on all LLM calls for run-to-run consistency
Report URL: https://github.com/apache/airflow/actions/runs/26977679861
With regards,
GitHub Actions via GitBox
---------------------------------------------------------------------
To unsubscribe, e-mail: jobs-unsubscribe@airflow.apache.org
For additional commands, e-mail: jobs-help@airflow.apache.org