You are viewing a plain text version of this content. The canonical link for it is here.
Posted to discuss-archive@tvm.apache.org by "SamJSui (via GitHub)" <gi...@apache.org> on 2026/08/18 14:02:09 UTC

[PR] [Fix][DLight] Handle rank-one GEMV cache loads [tvm]

SamJSui opened a new pull request, #20158:
URL: https://github.com/apache/tvm/pull/20158

   DLight's GPU GEMV rule assumes that the final two loops around a local cache
   read are both owned by the cache stage. Rank-one vector inputs create only one
   cache loop, causing the rule to include the shared placement loop and attempt
   to fuse an imperfect loop nest.
   
   This change records the cache loop count before `compute_at` and recovers that
   innermost suffix afterward. A single cache loop is used directly, while the
   existing final-two-loop fusion is preserved for higher-rank inputs.
   
   A focused regression verifies that rank-one GEMV scheduling completes and that
   the local vector load remains vectorized.
   
   Fixes #20118
   
   Testing:
   
   - `python -m pytest tests/python/s_tir/dlight/test_gpu_gemv.py -q` — 14 passed
   - `python -m pytest tests/python/relax/test_pipeline.py -q` — 24 passed
   - Exact issue reproducer — passed
   - RTX 4070 Ti SUPER (SM89): FP32/FP16 widths 2, 3, 32, 33, and 128 — NumPy parity
   - `pre-commit run --all-files` — passed
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: discuss-archive-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: discuss-archive-unsubscribe@tvm.apache.org
For additional commands, e-mail: discuss-archive-help@tvm.apache.org


Re: [PR] [Fix][DLight] Handle rank-one GEMV cache loads [tvm]

Posted by "tlopex (via GitHub)" <gi...@apache.org>.
tlopex merged PR #20158:
URL: https://github.com/apache/tvm/pull/20158


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: discuss-archive-unsubscribe@tvm.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: discuss-archive-unsubscribe@tvm.apache.org
For additional commands, e-mail: discuss-archive-help@tvm.apache.org