Skip to content

Commit f030ec1

Browse files
authored
Vulkan Embedding Fix (#7360)
* Fix empty Vulkan host buffers Add fp32 fp16 matmul shader Fix matmul shader alignment * Remove deprecated tensor->backend uses * Fix Vulkan validation errors on embedding models with no offloaded layers * Fix Vulkan llava segfault when not offloading layers
1 parent e4e6f67 commit f030ec1

File tree

3 files changed

+8874
-5271
lines changed

3 files changed

+8874
-5271
lines changed

0 commit comments

Comments
 (0)