We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 5e1c408 commit ed92c3dCopy full SHA for ed92c3d
ggml-metal.metal
@@ -235,6 +235,12 @@ kernel void kernel_norm(
235
236
// VARIANCE
237
// parallel sum
238
+ //
239
+ // WARNING: combining this loop with the one above will give you wrong results for nth == 256
240
+ // I have no idea why, so for now I am keeping them separate. But this behavior is very concerning.
241
+ // Tested with:
242
+ // ./perplexity -m ./falcon-7b/ggml-model-q4_0.gguf -f wiki.test.raw -ngl 1 -t 4
243
244
sum[tpitg] = 0.0f;
245
for (int i00 = tpitg; i00 < ne00; i00 += ntg) {
246
sum[tpitg] += y[i00] * y[i00];
0 commit comments