Skip to content

Calculate 5 summaries while running benchmarks #42

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 6 commits into from
Jan 28, 2021
Merged

Conversation

chriselrod
Copy link
Collaborator

@chriselrod chriselrod commented Jan 28, 2021

Now you can specify which summary you want when calling benchmark_result_df:

julia> benchmark_result_df(rb)
18×4 DataFrame
 Row │ Size   Library   Seconds      GFLOPS
     │ Int64  String    Float64      Float64
─────┼──────────────────────────────────────────
   120  BLIS      4.29e-5        0.37296
   245  BLIS      4.5419e-5      4.01264
   3100  BLIS      9.7717e-5     20.4673
   420  Gaius     2.62847e-7    60.8719
   545  Gaius     0.000264588    0.688807
   6100  Gaius     5.9732e-5     33.4829
   720  MKL       4.40768e-7    36.3003
   845  MKL       2.47089e-6    73.7589
   9100  MKL       5.46717e-6   365.82
  1020  Octavian  2.39237e-7    66.8793
  1145  Octavian  2.17778e-6    83.6862
  12100  Octavian  4.73643e-6   422.259
  1320  OpenBLAS  7.06423e-7    22.6493
  1445  OpenBLAS  4.98383e-6    36.5682
  15100  OpenBLAS  1.443e-5     138.6
  1620  Tullio    2.6291e-7     60.8574
  1745  Tullio    2.16711e-6    84.0981
  18100  Tullio    0.000125153   15.9804

julia> benchmark_result_df(rb, :median)
18×4 DataFrame
 Row │ Size   Library   Seconds      GFLOPS
     │ Int64  String    Float64      Float64
─────┼──────────────────────────────────────────
   120  BLIS      4.71605e-5     0.339267
   245  BLIS      4.9872e-5      3.65436
   3100  BLIS      0.000125569   15.9274
   420  Gaius     2.64962e-7    60.3861
   545  Gaius     0.000304132    0.599246
   6100  Gaius     0.000279572    7.15381
   720  MKL       4.44111e-7    36.027
   845  MKL       2.50067e-6    72.8806
   9100  MKL       5.87317e-6   340.532
  1020  Octavian  2.40778e-7    66.4513
  1145  Octavian  2.20433e-6    82.6781
  12100  Octavian  4.83843e-6   413.357
  1320  OpenBLAS  7.12453e-7    22.4576
  1445  OpenBLAS  5.137e-6      35.4779
  15100  OpenBLAS  1.5909e-5    125.715
  1620  Tullio    2.63827e-7    60.6457
  1745  Tullio    2.21511e-6    82.2758
  18100  Tullio    0.000191986   10.4174

or plot

julia> plot(rb, measure=:median)

image

As an aside, seems like plot should probably display the plot instead of just returning the files where it saves them. I added that as an option.

@chriselrod
Copy link
Collaborator Author

chriselrod commented Jan 28, 2021

The colors are wrong...
EDIT: Fixed, updated the above plot.

@chriselrod chriselrod merged commit 37c3497 into master Jan 28, 2021
@DilumAluthge DilumAluthge deleted the optionalsummaries branch January 28, 2021 18:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant