File tree Expand file tree Collapse file tree 2 files changed +5
-2
lines changed Expand file tree Collapse file tree 2 files changed +5
-2
lines changed Original file line number Diff line number Diff line change @@ -30,3 +30,6 @@ streamlit
30
30
31
31
# Server mode
32
32
flask
33
+
34
+ # eval
35
+ lm_eval == 0.4.2
Original file line number Diff line number Diff line change 9
9
10
10
Torchchat provides evaluation functionality for your language model on
11
11
a variety of tasks using the
12
- [ lm-evaluation-harness] ( https://github.com/facebookresearch/lm_eval )
12
+ [ lm-evaluation-harness] ( https://github.com/EleutherAI/lm-evaluation-harness )
13
13
library.
14
14
15
15
## Usage
@@ -34,6 +34,6 @@ Running multiple tasks and calling eval.py directly:
34
34
python3 torchchat.py eval stories15M --pte-path stories15M.pte --tasks wikitext hellaswag
35
35
```
36
36
37
- For more information and a list of tasks/metrics see [ lm-evaluation-harness] ( https://github.com/facebookresearch/lm_eval ) .
37
+ For more information and a list of tasks/metrics see [ lm-evaluation-harness] ( https://github.com/EleutherAI/lm-evaluation-harness ) .
38
38
39
39
[ end default ] : end
You can’t perform that action at this time.
0 commit comments