Skip to content

Commit 6a238d7

Browse files
JohannesGaesslerteleprint-me
authored andcommitted
CUDA: remove incorrect precision check (ggml-org#7454)
1 parent 2fd6ea2 commit 6a238d7

File tree

1 file changed

+0
-3
lines changed

1 file changed

+0
-3
lines changed

ggml-cuda/fattn-tile-f32.cu

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -286,9 +286,6 @@ void ggml_cuda_flash_attn_ext_tile_f32(ggml_backend_cuda_context & ctx, ggml_ten
286286
const ggml_tensor * KQV = dst;
287287
const ggml_tensor * Q = dst->src[0];
288288

289-
const int32_t precision = KQV->op_params[2];
290-
GGML_ASSERT(precision == GGML_PREC_DEFAULT);
291-
292289
if (Q->ne[1] <= 16) {
293290
constexpr int cols_per_block = 16;
294291
constexpr int parallel_blocks = 4;

0 commit comments

Comments
 (0)