Skip to content

Commit 84cc759

Browse files
celine-leeceline-lee
committed
Deployed 001d787 with MkDocs version: 1.6.1
1 parent 0038905 commit 84cc759

File tree

38 files changed

+842
-875
lines changed

38 files changed

+842
-875
lines changed

‎404.html

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -266,7 +266,7 @@
266266

267267

268268
<span class="md-ellipsis">
269-
Submission Analysis
269+
Leaderboard
270270
</span>
271271

272272

‎about/index.html

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -266,7 +266,7 @@
266266

267267

268268
<span class="md-ellipsis">
269-
Submission Analysis
269+
Leaderboard
270270
</span>
271271

272272

‎agent/index.html

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -329,7 +329,7 @@
329329

330330

331331
<span class="md-ellipsis">
332-
Submission Analysis
332+
Leaderboard
333333
</span>
334334

335335

‎analysis/index.html

Lines changed: 90 additions & 29 deletions
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@
1818

1919

2020

21-
<title>Submission Analysis - </title>
21+
<title>Leaderboard - </title>
2222

2323

2424

@@ -61,6 +61,11 @@
6161
<label class="md-overlay" for="__drawer"></label>
6262
<div data-md-component="skip">
6363

64+
65+
<a href="#leaderboard-lite" class="md-skip">
66+
Skip to content
67+
</a>
68+
6469
</div>
6570
<div data-md-component="announce">
6671

@@ -92,7 +97,7 @@
9297
<div class="md-header__topic" data-md-component="header-topic">
9398
<span class="md-ellipsis">
9499

95-
Submission Analysis
100+
Leaderboard
96101

97102
</span>
98103
</div>
@@ -271,16 +276,62 @@
271276

272277

273278

279+
<label class="md-nav__link md-nav__link--active" for="__toc">
280+
281+
282+
<span class="md-ellipsis">
283+
Leaderboard
284+
</span>
285+
286+
287+
<span class="md-nav__icon md-icon"></span>
288+
</label>
289+
274290
<a href="./" class="md-nav__link md-nav__link--active">
275291

276292

277293
<span class="md-ellipsis">
278-
Submission Analysis
294+
Leaderboard
279295
</span>
280296

281297

282298
</a>
283299

300+
301+
302+
<nav class="md-nav md-nav--secondary" aria-label="Table of contents">
303+
304+
305+
306+
307+
<label class="md-nav__title" for="__toc">
308+
<span class="md-nav__icon md-icon"></span>
309+
Table of contents
310+
</label>
311+
<ul class="md-nav__list" data-md-component="toc" data-md-scrollfix>
312+
313+
<li class="md-nav__item">
314+
<a href="#leaderboard-lite" class="md-nav__link">
315+
<span class="md-ellipsis">
316+
Leaderboard (lite)
317+
</span>
318+
</a>
319+
320+
</li>
321+
322+
<li class="md-nav__item">
323+
<a href="#leaderboard-all" class="md-nav__link">
324+
<span class="md-ellipsis">
325+
Leaderboard (all)
326+
</span>
327+
</a>
328+
329+
</li>
330+
331+
</ul>
332+
333+
</nav>
334+
284335
</li>
285336

286337

@@ -303,6 +354,32 @@
303354

304355

305356

357+
<label class="md-nav__title" for="__toc">
358+
<span class="md-nav__icon md-icon"></span>
359+
Table of contents
360+
</label>
361+
<ul class="md-nav__list" data-md-component="toc" data-md-scrollfix>
362+
363+
<li class="md-nav__item">
364+
<a href="#leaderboard-lite" class="md-nav__link">
365+
<span class="md-ellipsis">
366+
Leaderboard (lite)
367+
</span>
368+
</a>
369+
370+
</li>
371+
372+
<li class="md-nav__item">
373+
<a href="#leaderboard-all" class="md-nav__link">
374+
<span class="md-ellipsis">
375+
Leaderboard (all)
376+
</span>
377+
</a>
378+
379+
</li>
380+
381+
</ul>
382+
306383
</nav>
307384
</div>
308385
</div>
@@ -316,32 +393,16 @@
316393

317394

318395

319-
<h1>Submission Analysis</h1>
320-
321-
<table>
322-
<thead>
323-
<tr>
324-
<th></th>
325-
<th>Name</th>
326-
<th>Summary</th>
327-
<th></th>
328-
</tr>
329-
</thead>
330-
<tbody>
331-
<tr>
332-
<td></td>
333-
<td><a href="analysis_reference">reference</a></td>
334-
<td>3628 / 3643 ; duration: 17.67s</td>
335-
<td></td>
336-
</tr>
337-
<tr>
338-
<td></td>
339-
<td><a href="analysis_baseline">baseline</a></td>
340-
<td>376 / 947 ; duration: 15.68s</td>
341-
<td></td>
342-
</tr>
343-
</tbody>
344-
</table>
396+
<h1>Leaderboard</h1>
397+
398+
<h2 id="leaderboard-lite">Leaderboard (lite)</h2>
399+
<p>| | Name | Repos Resolved /10 | Test Duration (s) | Date | Analysis | |
400+
|--|------|-----------|------|----------|------|---|--------| |
401+
||<a href="commit-0.github.io">Reference (Gold)</a>|10|21.13NA|<a href="analysis_reference">Analysis</a>||
402+
||<a href="commit-0.github.io">Claude Sonnet - Base</a>|7|14.8509/25/2024|<a href="analysis_baseline">Analysis</a>||</p>
403+
<h2 id="leaderboard-all">Leaderboard (all)</h2>
404+
<p>| | Name | Repos Resolved /56 | Test Duration (s) | Date | Analysis | |
405+
|--|------|-----------|------|----------|------|---|--------| |</p>
345406

346407

347408

‎analysis_baseline/index.html

Lines changed: 18 additions & 60 deletions
Original file line numberDiff line numberDiff line change
@@ -59,6 +59,11 @@
5959
<label class="md-overlay" for="__drawer"></label>
6060
<div data-md-component="skip">
6161

62+
63+
<a href="#submission-name-claude-sonnet-base-lite" class="md-skip">
64+
Skip to content
65+
</a>
66+
6267
</div>
6368
<div data-md-component="announce">
6469

@@ -266,7 +271,7 @@
266271

267272

268273
<span class="md-ellipsis">
269-
Submission Analysis
274+
Leaderboard
270275
</span>
271276

272277

@@ -292,6 +297,8 @@
292297

293298

294299

300+
301+
295302

296303
</nav>
297304
</div>
@@ -306,77 +313,28 @@
306313

307314

308315

309-
<h1>Analysis baseline</h1>
310-
311316
<p><a href="analysis">back to all submissions</a></p>
317+
<h1 id="submission-name-claude-sonnet-base-lite">Submission Name: Claude Sonnet - Base (lite)</h1>
312318
<table>
313319
<thead>
314320
<tr>
315321
<th></th>
316322
<th>Repository</th>
317-
<th>Summary</th>
323+
<th>Resolved</th>
324+
<th>Pass Rate</th>
325+
<th>Test Duration (s)</th>
326+
<th>Analysis</th>
318327
<th></th>
319328
</tr>
320329
</thead>
321330
<tbody>
322331
<tr>
323332
<td></td>
324-
<td><a href="analysis_baseline_simpy">simpy</a></td>
325-
<td><code>tests</code>: 20 / 150 ; duration: 1.37s</td>
326-
<td></td>
327-
</tr>
328-
<tr>
329-
<td></td>
330-
<td><a href="analysis_baseline_tinydb">tinydb</a></td>
331-
<td>failure</td>
332-
<td></td>
333-
</tr>
334-
<tr>
335-
<td></td>
336-
<td><a href="analysis_baseline_marshmallow">marshmallow</a></td>
337-
<td>failure</td>
338-
<td></td>
339-
</tr>
340-
<tr>
341-
<td></td>
342-
<td><a href="analysis_baseline_wcwidth">wcwidth</a></td>
343-
<td><code>tests</code>: 6 / 39 ; duration: 1.52s</td>
344-
<td></td>
345-
</tr>
346-
<tr>
347-
<td></td>
348-
<td><a href="analysis_baseline_imapclient">imapclient</a></td>
349-
<td><code>tests</code>: 0 / 0 ; duration: 0.54s</td>
350-
<td></td>
351-
</tr>
352-
<tr>
353-
<td></td>
354-
<td><a href="analysis_baseline_voluptuous">voluptuous</a></td>
355-
<td><code>tests</code>: 0 / 1 ; duration: 0.19s</td>
356-
<td></td>
357-
</tr>
358-
<tr>
359-
<td></td>
360-
<td><a href="analysis_baseline_jinja">jinja</a></td>
361-
<td>failure</td>
362-
<td></td>
363-
</tr>
364-
<tr>
365-
<td></td>
366-
<td><a href="analysis_baseline_deprecated">deprecated</a></td>
367-
<td><code>tests</code>: 80 / 171 ; duration: 0.94s</td>
368-
<td></td>
369-
</tr>
370-
<tr>
371-
<td></td>
372-
<td><a href="analysis_baseline_cookiecutter">cookiecutter</a></td>
373-
<td><code>tests</code>: 97 / 371 ; duration: 10.60s</td>
374-
<td></td>
375-
</tr>
376-
<tr>
377-
<td></td>
378-
<td><a href="analysis_baseline_cachetools">cachetools</a></td>
379-
<td><code>tests</code>: 173 / 215 ; duration: 0.52s</td>
333+
<td>cachetools</td>
334+
<td>No</td>
335+
<td>173 / 215</td>
336+
<td>0.69</td>
337+
<td>analysis_baseline_cachetools</td>
380338
<td></td>
381339
</tr>
382340
</tbody>

‎analysis_baseline_cachetools/index.html

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -271,7 +271,7 @@
271271

272272

273273
<span class="md-ellipsis">
274-
Submission Analysis
274+
Leaderboard
275275
</span>
276276

277277

@@ -845,7 +845,7 @@ <h3 id="test_funcpyttldecoratortesttest_decorator_user_function">test_func.py::T
845845
<h3 id="test_keyspycachekeystesttest_typedkey">test_keys.py::CacheKeysTest::test_typedkey</h3>
846846
<details><summary> <pre>test_keys.py::CacheKeysTest::test_typedkey</pre></summary><pre>
847847
self = <tests.test_keys.CacheKeysTest testMethod=test_typedkey>
848-
key = <function typedkey at 0x7f9f95ac1480>
848+
key = <function typedkey at 0x7edb386cd480>
849849

850850
def test_typedkey(self, key=cachetools.keys.typedkey):
851851
self.assertEqual(key(), key())
@@ -863,7 +863,7 @@ <h3 id="test_keyspycachekeystesttest_typedkey">test_keys.py::CacheKeysTest::test
863863
<h3 id="test_keyspycachekeystesttest_typedmethodkey">test_keys.py::CacheKeysTest::test_typedmethodkey</h3>
864864
<details><summary> <pre>test_keys.py::CacheKeysTest::test_typedmethodkey</pre></summary><pre>
865865
self = <tests.test_keys.CacheKeysTest testMethod=test_typedmethodkey>
866-
key = <function typedmethodkey at 0x7f9f95ac1510>
866+
key = <function typedmethodkey at 0x7edb386cd510>
867867

868868
def test_typedmethodkey(self, key=cachetools.keys.typedmethodkey):
869869
# similar to typedkey(), but ignores its first positional argument

0 commit comments

Comments
 (0)