File tree Expand file tree Collapse file tree 1 file changed +4
-0
lines changed Expand file tree Collapse file tree 1 file changed +4
-0
lines changed Original file line number Diff line number Diff line change @@ -258,9 +258,11 @@ mkdir -p build && cd build
258
258
259
259
# Option 1: Use FP16 for better performance in long-prompt inference
260
260
cmake .. -DLLAMA_SYCL=ON -DCMAKE_C_COMPILER=icx -DCMAKE_CXX_COMPILER=icpx -DLLAMA_SYCL_F16=ON
261
+ make
261
262
262
263
# Option 2: Use FP32 by default
263
264
cmake .. -DLLAMA_SYCL=ON -DCMAKE_C_COMPILER=icx -DCMAKE_CXX_COMPILER=icpx
265
+ make
264
266
```
265
267
266
268
#### Nvidia GPU
@@ -276,9 +278,11 @@ mkdir -p build && cd build
276
278
277
279
# Option 1: Use FP16 for better performance in long-prompt inference
278
280
cmake .. -DLLAMA_SYCL=ON -DLLAMA_SYCL_TARGET=NVIDIA -DCMAKE_C_COMPILER=icx -DCMAKE_CXX_COMPILER=icpx -DLLAMA_SYCL_F16=ON
281
+ make
279
282
280
283
# Option 2: Use FP32 by default
281
284
cmake .. -DLLAMA_SYCL=ON -DLLAMA_SYCL_TARGET=NVIDIA -DCMAKE_C_COMPILER=icx -DCMAKE_CXX_COMPILER=icpx
285
+ make
282
286
```
283
287
284
288
### III. Run the inference
You can’t perform that action at this time.
0 commit comments