[benchmark] ReportFormatter: Improved single_table headers

[palimondo]

This PR improves single_table mode of ReportFormatter:

• Add unit test coverage.
• Print labels for the numeric columns on inline headers.
• Visually distinguish sections by a separator row preceding the the inline headers.
• Separate header label styles for git and markdown modes with UPPERCASE and Bold formatting respectively.

[palimondo]

@swift-ci please benchmark

[palimondo]

I'm hoping some false change will pop up during benchmark, otherwise I will have to commit and revert some renamed benchmark… 🤞.

[PFCAwesome]

Stop

…

On Thu, May 23, 2019, 16:37 Pavol Vaskovic ***@***.***> wrote: I'm hoping some false change will pop up during benchmark, otherwise I will have to commit and revert some renamed benchmark… 🤞. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#25027>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AGVJKIGODO7QAJMXHSV4BQDPW4FBRANCNFSM4HPKO3UQ> .

[swift-ci]

Performance: -O

Code size: -O

Performance: -Osize

Code size: -Osize

Performance: -Onone

Code size: -swiftlibs

How to read the data

The tables contain differences in performance which are larger than 8% and differences in code size which are larger than 1%.

If you see any unexpected regressions, you should consider fixing the
regressions before you merge the PR.

Noise: Sometimes the performance results (not code size!) contain false
alarms. Unexpected regressions which are marked with '(?)' are probably noise.
If you see regressions which you cannot explain you can try to run the
benchmarks again. If regressions still show up, please consult with the
performance team (@eeckstein).

Hardware Overview

  Model Name: Mac Pro
  Model Identifier: MacPro6,1
  Processor Name: 12-Core Intel Xeon E5
  Processor Speed: 2.7 GHz
  Number of Processors: 1
  Total Number of Cores: 12
  L2 Cache (per Core): 256 KB
  L3 Cache: 30 MB
  Memory: 64 GB

[palimondo]

@swift-ci please benchmark

[swift-ci]

Performance: -O

Added	MIN	MAX	MEAN	MAX_RSS
ArrayValueProp42	4	4	4	—
Removed	MIN	MAX	MEAN	MAX_RSS
ArrayValueProp4	4	5	4	—

Code size: -O

Regression	OLD	NEW	DELTA	RATIO
ArrayLiteral.o	3311	3352	+1.2%	0.99x

Performance: -Osize

Improvement	OLD	NEW	DELTA	RATIO
LuhnAlgoEager	656	613	-6.6%	1.07x (?)
Added	MIN	MAX	MEAN	MAX_RSS
ArrayValueProp42	4	4	4	—
Removed	MIN	MAX	MEAN	MAX_RSS
ArrayValueProp4	4	4	4	—

Code size: -Osize

Performance: -Onone

Added	MIN	MAX	MEAN	MAX_RSS
ArrayValueProp42	2785	2928	2833	—
Removed	MIN	MAX	MEAN	MAX_RSS
ArrayValueProp4	2778	2817	2791	—

Code size: -swiftlibs

✅	Benchmark Check Report
⚠️⏱	ArrayValueProp42 execution took 4 μs. Increase the workload of ArrayValueProp42 to be more than 20 μs.

How to read the data

The tables contain differences in performance which are larger than 8% and differences in code size which are larger than 1%.

If you see any unexpected regressions, you should consider fixing the
regressions before you merge the PR.

Noise: Sometimes the performance results (not code size!) contain false
alarms. Unexpected regressions which are marked with '(?)' are probably noise.
If you see regressions which you cannot explain you can try to run the
benchmarks again. If regressions still show up, please consult with the
performance team (@eeckstein).

Hardware Overview

  Model Name: Mac mini
  Model Identifier: Macmini8,1
  Processor Name: Intel Core i7
  Processor Speed: 3.2 GHz
  Number of Processors: 1
  Total Number of Cores: 6
  L2 Cache (per Core): 256 KB
  L3 Cache: 12 MB
  Memory: 64 GB

[palimondo]

@swift-ci smoke test and merge