Skip to content

Commit a4e82fd

Browse files
committed
Clarify docs
1 parent 54d028d commit a4e82fd

File tree

1 file changed

+6
-5
lines changed

1 file changed

+6
-5
lines changed

docs/comparison-analysis.md

Lines changed: 6 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -56,12 +56,13 @@ The relevance test run summary is determined by the number of significant and re
5656

5757
#### Magnitude
5858

59-
Magnitude is a combination of two factors:
60-
* how large a change is regardless of the direction of the change
61-
* The point at which a change is considered in a different magnitude category depends on the metric being analyzed.
62-
* how much that change went over the significance threshold
59+
Magnitude is a small set of discrete buckets describing how "big" a change is from "very small" to "very large". It is a combination of two factors:
60+
* how much that change went over the significance threshold.
61+
* this criteria is the same regardless of which metric is being measured.
62+
* how large percentage wise a change is regardless of the direction of the change.
63+
* which bucket a change falls into is metric dependent (i.e., changes of the same percent might fall into different buckets depending on the metric in question)
6364

64-
As an example, if a change that is large in absolute terms only exceeds the significance threshold by a small factor, then the overall magnitude of the change is considered small.
65+
As an example, if a change that is large in absolute terms only exceeds the significance threshold by a small factor, then the overall magnitude of the change is considered small. On the other hand, if a change is small in absolute terms but exceeds the significance threshold by a very large amount, then the overall magnitude of the change is considered large.
6566

6667
#### Relevance algorithm
6768

0 commit comments

Comments
 (0)