Skip to content

Commit 8699330

Browse files
committed
RWKV 6: Fix error in ggml_cuda_op_bin_bcast
Signed-off-by: Molly Sophia <[email protected]>
1 parent ff3d226 commit 8699330

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

convert_hf_to_gguf.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -324,12 +324,14 @@ def prepare_tensors(self):
324324
gguf.MODEL_TENSOR.TIME_MIX_FIRST,
325325
gguf.MODEL_TENSOR.TIME_MIX_W1,
326326
gguf.MODEL_TENSOR.TIME_MIX_W2,
327+
gguf.MODEL_TENSOR.TIME_MIX_DECAY,
327328
gguf.MODEL_TENSOR.TIME_MIX_DECAY_W1,
328329
gguf.MODEL_TENSOR.TIME_MIX_DECAY_W2,
329330
gguf.MODEL_TENSOR.POSNET_NORM1,
330331
gguf.MODEL_TENSOR.POSNET_NORM2,
331332
)
332333
)
334+
or "lerp" in new_name
333335
or not new_name.endswith(".weight")
334336
):
335337
data_qtype = gguf.GGMLQuantizationType.F32

0 commit comments

Comments
 (0)