Skip to content

Benchmark result df #40

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 5 commits into from
Jan 27, 2021
Merged

Benchmark result df #40

merged 5 commits into from
Jan 27, 2021

Conversation

chriselrod
Copy link
Collaborator

Example:

julia> benchmark_result_df(rb)
18×4 DataFrame
 Row │ Sizes  Library   Seconds      GFLOPS
     │ Int64  String    Float64      Float64
─────┼───────────────────────────────────────────
   120  BLIS      4.276e-5        0.374181
   277  BLIS      8.2822e-5      11.0244
   3300  BLIS      0.000295945   182.466
   420  Gaius     2.63026e-7     60.8306
   577  Gaius     0.000269507     3.38791
   6300  Gaius     0.000588027    91.8325
   720  MKL       4.41985e-7     36.2003
   877  MKL       4.38214e-6    208.361
   9300  MKL       4.4458e-5    1214.63
  1020  Octavian  2.4756e-7      64.6307
  1177  Octavian  2.85825e-6    319.449
  12300  Octavian  4.3652e-5    1237.06
  1320  OpenBLAS  7.15642e-7     22.3576
  1477  OpenBLAS  1.2527e-5      72.8878
  15300  OpenBLAS  9.8837e-5     546.354
  1620  Tullio    2.56611e-7     62.3512
  1777  Tullio    9.1536e-5       9.97494
  18300  Tullio    0.000415785   129.875

@DilumAluthge
Copy link
Member

Could you add the following as a test:

import BLASBenchmarksCPU
import StatsPlots
benchmark_result = BLASBenchmarksCPU.runbench(Float64; sizes = [1, 2, 5, 10, 20, 50, 100, 200, 500, 1_000])
df = BLASBenchmarksCPU.benchmark_result_df(benchmark_result)
@test df isa DataFrame
df[!, :Size] = Float64.(df[!, :Size])
df[!, :GFLOPS] = Float64.(df[!, :GFLOPS])
df[!, :Time] = Float64.(df[!, :Time])
p = StatsPlots.@df df StatsPlots.plot(:Size, :GFLOPS; group = :Library, legend = :bottomright)

@DilumAluthge
Copy link
Member

DilumAluthge commented Jan 27, 2021

That test basically covers the main use case.

@chriselrod
Copy link
Collaborator Author

I named the time column Seconds instead of Time to be explicit about units.

@chriselrod chriselrod merged commit 59308be into master Jan 27, 2021
@chriselrod chriselrod deleted the benchmark_result_df branch January 27, 2021 19:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants