Skip to content

Commit 772703c

Browse files
authored
vulkan: Optimize some mat-vec mul quant shaders (#10296)
Compute two result elements per workgroup (for Q{4,5}_{0,1}). This reuses the B loads across the rows and also reuses some addressing calculations. This required manually partially unrolling the loop, since the compiler is less willing to unroll outer loops. Add bounds-checking on the last iteration of the loop. I think this was at least partly broken before. Optimize the Q4_K shader to vectorize most loads and reduce the number of bit twiddling instructions.
1 parent dd3a6ce commit 772703c

File tree

4 files changed

+210
-131
lines changed

4 files changed

+210
-131
lines changed

0 commit comments

Comments
 (0)