Skip to content

[test-suite] Document the LLVM test-suite benchmark apps #105843

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Aug 30, 2024
Merged

[test-suite] Document the LLVM test-suite benchmark apps #105843

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
38 changes: 38 additions & 0 deletions llvm/docs/TestSuiteGuide.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -135,6 +135,44 @@ Every program can work as a correctness test. Some programs are unsuitable for
performance measurements. Setting the `TEST_SUITE_BENCHMARKING_ONLY` CMake
option to `ON` will disable them.

The MultiSource benchmarks consist of the following apps and benchmarks:

| MultiSource | Language | Application Area | Remark |
|----------------------|-----------|-------------------------------|----------------------|
| 7zip | C/C++ | Compression/Decompression | |
| ASCI_Purple | C | SMG2000 benchmark and solver | Memory intensive app |
| ASC_Sequoia | C | Simulation and solver | |
| BitBench | C | uudecode/uuencode utility | Bit Stream benchmark for functional compilers |
| Bullet | C++ | Bullet 2.75 physics engine | |
| DOE-ProxyApps-C++ | C++ | HPC/scientific apps | Small applications, representative of our larger DOE workloads |
| DOE-ProxyApps-C | C | HPC/scientific apps | " |
| Fhourstones | C | Game/solver | Integer benchmark that efficiently solves positions in the game of Connect-4 |
| Fhourstones-3.1 | C | Game/solver | " |
| FreeBench | C | Benchmark suite | Raytracer, four in a row, neural network, file compressor, Fast Fourier/Cosine/Sine Transform |
| llubenchmark | C | Linked-list micro-benchmark | |
| mafft | C | Bioinformatics | A multiple sequence alignment program |
| MallocBench | C | Benchmark suite | cfrac, espresso, gawk, gs, make, p2c, perl |
| McCat | C | Benchmark suite | Quicksort, bubblesort, eigenvalues |
| mediabench | C | Benchmark suite | adpcm, g721, gsm, jpeg, mpeg2 |
| MiBench | C | Embedded benchmark suite | Automotive, consumer, office, security, telecom apps |
| nbench | C | | BYTE Magazine's BYTEmark benchmark program |
| NPB-serial | C | Parallel computing | Serial version of the NPB IS code |
| Olden | C | Data Structures | SGI version of the Olden benchmark |
| OptimizerEval | C | Solver | Preston Brigg's optimizer evaluation framework |
| PAQ8p | C++ | Data compression | |
| Prolangs-C++ | C++ | Benchmark suite | city, employ, life, NP, ocean, primes, simul, vcirc |
| Prolangs-C | C | Benchmark suite | agrep, archie-client, bison, gnugo, unix-smail |
| Ptrdist | C | Pointer-Intensive Benchmark Suite | |
| Rodinia | C | Scientific apps | backprop, pathfinder, srad |
| SciMark2-C | C | Scientific apps | FFT, LU, Montecarlo, sparse matmul |
| sim | C | Dynamic programming | A Time-Efficient, Linear-Space Local Similarity Algorithm |
| tramp3d-v4 | C++ | Numerical analysis | Template-intensive numerical program based on FreePOOMA |
| Trimaran | C | Encryption | 3des, md5, crc |
| TSVC | C | Vectorization benchmark | Test Suite for Vectorizing Compilers (TSVC) |
| VersaBench | C | Benchmark suite | 8b10b, beamformer, bmm, dbms, ecbdes |

All MultiSource applications are suitable for performance measurements
and will run when CMake option `TEST_SUITE_BENCHMARKING_ONLY` is set.

Configuration
-------------
Expand Down
Loading