-
Notifications
You must be signed in to change notification settings - Fork 219
Models
Nathan Cooper edited this page Jul 22, 2021
·
22 revisions
| Model | Dataset Used | pass@1 | pass@2 | pass@5 | pass@10 |
|---|---|---|---|---|---|
| gpt-neo-125M | The Pile | 0.12% | 0.24% | 0.61% | 1.22% |
| gpt-neo-125M | Apps (Train) | 0.06% | 0.12% | 0.30% | 0.61% |
| gpt-neo-1.3B | Apps (Train + Test) | Desc... | |||
| gpt-neo-125M | Code Clippy Data | 0.00% | 0.00% | 0.00% | 0.00% |
| gpt-neo-125M | Code Clippy Data (Deduplicated) | 0.00% | 0.00% | 0.00% | 0.00% |
| gpt-neo-125M | Code Search Net Challenge (All) | 0.00% | 0.00% | 0.00% | 0.00% |
| gpt-neo-125M | Code Search Net Challenge (Python) | 0.00% | 0.00% | 0.00% | 0.00% |