Skip to content

Commit 8be03e1

Browse files
bjee19bjee19
committed
Add pr workflow test summaries
1 parent dcedd76 commit 8be03e1

File tree

10 files changed

+97
-52
lines changed

10 files changed

+97
-52
lines changed

‎tests/results/dp-perf/1.6.0/1.6.0-oss.md

Lines changed: 9 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,10 @@ GKE Cluster:
2020
- Zone: us-west1-b
2121
- Instance Type: n2d-standard-16
2222

23+
## Summary:
24+
25+
- Performance stayed consistent with 1.5.0 results. Average latency slightly increased across all routing methods.
26+
2327
## Test1: Running latte path based routing
2428

2529
```text
@@ -29,7 +33,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 309.6µs, 718.534µs, 681.308µs
2933
Bytes In [total, mean] 4741568, 158.05
3034
Bytes Out [total, mean] 0, 0.00
3135
Success [ratio] 99.84%
32-
Status Codes [code:count] 200:29951 503:49
36+
Status Codes [code:count] 200:29951 503:49
3337
Error Set:
3438
503 Service Temporarily Unavailable
3539
```
@@ -43,7 +47,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 519.443µs, 728.205µs, 716.283
4347
Bytes In [total, mean] 4770000, 159.00
4448
Bytes Out [total, mean] 0, 0.00
4549
Success [ratio] 100.00%
46-
Status Codes [code:count] 200:30000
50+
Status Codes [code:count] 200:30000
4751
Error Set:
4852
```
4953

@@ -56,7 +60,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 533.22µs, 735.075µs, 722.549µ
5660
Bytes In [total, mean] 5010000, 167.00
5761
Bytes Out [total, mean] 0, 0.00
5862
Success [ratio] 100.00%
59-
Status Codes [code:count] 200:30000
63+
Status Codes [code:count] 200:30000
6064
Error Set:
6165
```
6266

@@ -69,7 +73,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 528.445µs, 724.715µs, 711.435
6973
Bytes In [total, mean] 4680000, 156.00
7074
Bytes Out [total, mean] 0, 0.00
7175
Success [ratio] 100.00%
72-
Status Codes [code:count] 200:30000
76+
Status Codes [code:count] 200:30000
7377
Error Set:
7478
```
7579

@@ -82,6 +86,6 @@ Latencies [min, mean, 50, 90, 95, 99, max] 538.368µs, 728.96µs, 714.974µ
8286
Bytes In [total, mean] 4680000, 156.00
8387
Bytes Out [total, mean] 0, 0.00
8488
Success [ratio] 100.00%
85-
Status Codes [code:count] 200:30000
89+
Status Codes [code:count] 200:30000
8690
Error Set:
8791
```

‎tests/results/dp-perf/1.6.0/1.6.0-plus.md

Lines changed: 9 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,10 @@ GKE Cluster:
2020
- Zone: us-west1-b
2121
- Instance Type: n2d-standard-16
2222

23+
## Summary:
24+
25+
- Performance stayed consistent with 1.5.0 results. Average latency slightly increased across all routing methods.
26+
2327
## Test1: Running latte path based routing
2428

2529
```text
@@ -29,7 +33,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 535.49µs, 722.768µs, 702.708µ
2933
Bytes In [total, mean] 4770000, 159.00
3034
Bytes Out [total, mean] 0, 0.00
3135
Success [ratio] 100.00%
32-
Status Codes [code:count] 200:30000
36+
Status Codes [code:count] 200:30000
3337
Error Set:
3438
```
3539

@@ -42,7 +46,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 558.587µs, 766.304µs, 750.921
4246
Bytes In [total, mean] 4800000, 160.00
4347
Bytes Out [total, mean] 0, 0.00
4448
Success [ratio] 100.00%
45-
Status Codes [code:count] 200:30000
49+
Status Codes [code:count] 200:30000
4650
Error Set:
4751
```
4852

@@ -55,7 +59,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 572.624µs, 771.492µs, 758.449
5559
Bytes In [total, mean] 5040000, 168.00
5660
Bytes Out [total, mean] 0, 0.00
5761
Success [ratio] 100.00%
58-
Status Codes [code:count] 200:30000
62+
Status Codes [code:count] 200:30000
5963
Error Set:
6064
```
6165

@@ -68,7 +72,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 549.224µs, 760.423µs, 746.75µ
6872
Bytes In [total, mean] 4710000, 157.00
6973
Bytes Out [total, mean] 0, 0.00
7074
Success [ratio] 100.00%
71-
Status Codes [code:count] 200:30000
75+
Status Codes [code:count] 200:30000
7276
Error Set:
7377
```
7478

@@ -81,6 +85,6 @@ Latencies [min, mean, 50, 90, 95, 99, max] 544.486µs, 762.077µs, 748.375
8185
Bytes In [total, mean] 4710000, 157.00
8286
Bytes Out [total, mean] 0, 0.00
8387
Success [ratio] 100.00%
84-
Status Codes [code:count] 200:30000
88+
Status Codes [code:count] 200:30000
8589
Error Set:
8690
```

‎tests/results/ngf-upgrade/1.6.0/1.6.0-oss.md

Lines changed: 7 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,11 @@ GKE Cluster:
2020
- Zone: us-west1-b
2121
- Instance Type: n2d-standard-16
2222

23+
## Summary:
24+
25+
- Latency increased across both HTTPS and HTTP traffic.
26+
27+
2328
## Test: Send http /coffee traffic
2429

2530
```text
@@ -29,7 +34,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 462.848µs, 904.959µs, 898.168
2934
Bytes In [total, mean] 968026, 161.34
3035
Bytes Out [total, mean] 0, 0.00
3136
Success [ratio] 100.00%
32-
Status Codes [code:count] 200:6000
37+
Status Codes [code:count] 200:6000
3338
Error Set:
3439
```
3540

@@ -44,7 +49,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 705.036µs, 1.009ms, 973.41µs,
4449
Bytes In [total, mean] 932022, 155.34
4550
Bytes Out [total, mean] 0, 0.00
4651
Success [ratio] 100.00%
47-
Status Codes [code:count] 200:6000
52+
Status Codes [code:count] 200:6000
4853
Error Set:
4954
```
5055

‎tests/results/ngf-upgrade/1.6.0/1.6.0-plus.md

Lines changed: 6 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,10 @@ GKE Cluster:
2020
- Zone: us-west1-b
2121
- Instance Type: n2d-standard-16
2222

23+
## Summary:
24+
25+
- Performance stayed consistent with 1.5.0 results.
26+
2327
## Test: Send http /coffee traffic
2428

2529
```text
@@ -29,7 +33,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 608.736µs, 814.699µs, 794.88µ
2933
Bytes In [total, mean] 967993, 161.33
3034
Bytes Out [total, mean] 0, 0.00
3135
Success [ratio] 100.00%
32-
Status Codes [code:count] 200:6000
36+
Status Codes [code:count] 200:6000
3337
Error Set:
3438
```
3539

@@ -44,7 +48,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 654.62µs, 940.714µs, 911.965µ
4448
Bytes In [total, mean] 930000, 155.00
4549
Bytes Out [total, mean] 0, 0.00
4650
Success [ratio] 100.00%
47-
Status Codes [code:count] 200:6000
51+
Status Codes [code:count] 200:6000
4852
Error Set:
4953
```
5054

‎tests/results/reconfig/1.6.0/1.6.0-oss.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,10 @@ GKE Cluster:
2020
- Zone: us-west1-b
2121
- Instance Type: n2d-standard-16
2222

23+
## Summary:
24+
25+
- Performance stayed consistent with 1.5.0 results.
26+
2327
## Test 1: Resources exist before startup - NumResources 30
2428

2529
### Reloads and Time to Ready
@@ -204,4 +208,3 @@ GKE Cluster:
204208
- +Infms: 1535
205209

206210
### NGINX Error Logs
207-

‎tests/results/reconfig/1.6.0/1.6.0-plus.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,10 @@ GKE Cluster:
2020
- Zone: us-west1-b
2121
- Instance Type: n2d-standard-16
2222

23+
## Summary:
24+
25+
- Performance stayed consistent with 1.5.0 results.
26+
2327
## Test 1: Resources exist before startup - NumResources 30
2428

2529
### Reloads and Time to Ready
@@ -204,4 +208,3 @@ GKE Cluster:
204208
- +Infms: 1458
205209

206210
### NGINX Error Logs
207-

‎tests/results/scale/1.6.0/1.6.0-oss.md

Lines changed: 6 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,10 @@ GKE Cluster:
2020
- Zone: us-west1-b
2121
- Instance Type: n2d-standard-16
2222

23+
## Summary:
24+
25+
- Performance improved. Average reload and event batch processing decreased across all test cases.
26+
2327
## Test TestScale_Listeners
2428

2529
### Reloads
@@ -185,7 +189,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 356.253µs, 792.759µs, 762.379
185189
Bytes In [total, mean] 4801650, 160.06
186190
Bytes Out [total, mean] 0, 0.00
187191
Success [ratio] 99.82%
188-
Status Codes [code:count] 200:29945 503:55
192+
Status Codes [code:count] 200:29945 503:55
189193
Error Set:
190194
503 Service Temporarily Unavailable
191195
```
@@ -196,6 +200,6 @@ Latencies [min, mean, 50, 90, 95, 99, max] 625.417µs, 865.972µs, 846.518
196200
Bytes In [total, mean] 4800000, 160.00
197201
Bytes Out [total, mean] 0, 0.00
198202
Success [ratio] 100.00%
199-
Status Codes [code:count] 200:30000
203+
Status Codes [code:count] 200:30000
200204
Error Set:
201205
```

‎tests/results/scale/1.6.0/1.6.0-plus.md

Lines changed: 10 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,14 @@ GKE Cluster:
2020
- Zone: us-west1-b
2121
- Instance Type: n2d-standard-16
2222

23+
## Summary:
24+
25+
- Performance is consistent with 1.6.0 results, except for a large increase in NGF and NGINX errors in the
26+
Scale Listeners and Scale HTTPS Listeners test cases.
27+
- Errors in Scale Upstream Servers test case are expected and of small importance.
28+
- Errors in Scale Listeners test case are expected and of small importance.
29+
- Errors in Scale HTTPS Listeners test case have not been seen in previous results and could be concerning.
30+
2331
## Test TestScale_Listeners
2432

2533
### Reloads
@@ -185,7 +193,7 @@ Latencies [min, mean, 50, 90, 95, 99, max] 551.972µs, 787.907µs, 754.116
185193
Bytes In [total, mean] 4800000, 160.00
186194
Bytes Out [total, mean] 0, 0.00
187195
Success [ratio] 100.00%
188-
Status Codes [code:count] 200:30000
196+
Status Codes [code:count] 200:30000
189197
Error Set:
190198
```
191199
```text
@@ -195,6 +203,6 @@ Latencies [min, mean, 50, 90, 95, 99, max] 648.624µs, 876.41µs, 851.428µ
195203
Bytes In [total, mean] 4800000, 160.00
196204
Bytes Out [total, mean] 0, 0.00
197205
Success [ratio] 100.00%
198-
Status Codes [code:count] 200:30000
206+
Status Codes [code:count] 200:30000
199207
Error Set:
200208
```

0 commit comments

Comments
 (0)