Skip to content

Commit 6c4cfe6

Browse files
xgchenaxgchena
authored
Add sample notebook to showcase monitoring model quality (#119)
Notebook created by nigenda@ and smuppala@
1 parent 9752b4c commit 6c4cfe6

File tree

8 files changed

+2281
-0
lines changed

8 files changed

+2281
-0
lines changed

‎sagemaker_model_monitor/model_quality/images/CW_ALARM_Model_Quality_1.png

67.7 KB
Loading

‎sagemaker_model_monitor/model_quality/images/CW_ALARM_Model_Quality_2.png

44.7 KB
Loading

‎sagemaker_model_monitor/model_quality/model/xgb-churn-prediction-model.tar.gz

33.1 KB
Binary file not shown.

‎sagemaker_model_monitor/model_quality/model_quality_churn_sdk.ipynb

Lines changed: 1078 additions & 0 deletions
Large diffs are not rendered by default.

‎sagemaker_model_monitor/model_quality/test_data/test-dataset-input-cols.csv

Lines changed: 334 additions & 0 deletions
Large diffs are not rendered by default.

‎sagemaker_model_monitor/model_quality/test_data/upload-test-file.txt

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
test file

‎sagemaker_model_monitor/model_quality/test_data/validation.csv

Lines changed: 666 additions & 0 deletions
Large diffs are not rendered by default.

‎sagemaker_model_monitor/model_quality/test_data/validation_with_predictions.csv

Lines changed: 202 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,202 @@
1+
probability,prediction,label
2+
0.01516005303710699,0,0
3+
0.1684480607509613,0,0
4+
0.21427156031131744,0,0
5+
0.06330718100070953,0,0
6+
0.02791607193648815,0,0
7+
0.014169521629810333,0,0
8+
0.00571369007229805,0,0
9+
0.10534518957138062,0,0
10+
0.025899196043610573,0,0
11+
0.6651358604431152,0,1
12+
0.03172963857650757,0,0
13+
0.09675747901201248,0,0
14+
0.35873568058013916,0,0
15+
0.023574918508529663,0,0
16+
0.0063100759871304035,0,0
17+
0.01659534126520157,0,0
18+
0.9036388993263245,1,1
19+
0.5863341093063354,0,0
20+
0.40476715564727783,0,0
21+
0.02699803188443184,0,0
22+
0.051476720720529556,0,0
23+
0.8226211071014404,1,1
24+
0.050476640462875366,0,0
25+
0.6812863945960999,0,0
26+
0.014689727686345577,0,0
27+
0.010139471851289272,0,0
28+
0.016720956191420555,0,0
29+
0.00886827427893877,0,0
30+
0.013370179571211338,0,0
31+
0.8598929047584534,1,1
32+
0.024568557739257812,0,0
33+
0.022816648706793785,0,0
34+
0.011015648953616619,0,0
35+
0.15493033826351166,0,0
36+
0.21677029132843018,0,0
37+
0.007811678573489189,0,0
38+
0.008974204771220684,0,0
39+
0.8475439548492432,1,1
40+
0.03913778066635132,0,0
41+
0.03130830079317093,0,0
42+
0.014615682885050774,0,0
43+
0.020784741267561913,0,0
44+
0.022972693666815758,0,0
45+
0.014104612171649933,0,0
46+
0.015749145299196243,0,0
47+
0.008738397620618343,0,0
48+
0.65254807472229,0,0
49+
0.4511687755584717,0,1
50+
0.9566231369972229,1,1
51+
0.024895407259464264,0,0
52+
0.040893565863370895,0,0
53+
0.023623693734407425,0,0
54+
0.022015830501914024,0,0
55+
0.0749708041548729,0,0
56+
0.950011134147644,1,1
57+
0.013898405246436596,0,0
58+
0.032197073101997375,0,0
59+
0.03624160215258598,0,0
60+
0.010548747144639492,0,0
61+
0.016746673732995987,0,0
62+
0.009298677556216717,0,0
63+
0.024385450407862663,0,0
64+
0.014508964493870735,0,0
65+
0.417207270860672,0,0
66+
0.033581387251615524,0,0
67+
0.010542895644903183,0,0
68+
0.042148198932409286,0,0
69+
0.025085315108299255,0,0
70+
0.025356534868478775,0,0
71+
0.02071845903992653,0,0
72+
0.04457199200987816,0,0
73+
0.02602040022611618,0,0
74+
0.008588895201683044,0,0
75+
0.005636055953800678,0,0
76+
0.35528650879859924,0,0
77+
0.03799867257475853,0,0
78+
0.011309231631457806,0,0
79+
0.9850918650627136,1,1
80+
0.2086630016565323,0,1
81+
0.010987108573317528,0,0
82+
0.015532182529568672,0,0
83+
0.016767162829637527,0,0
84+
0.029371926560997963,0,0
85+
0.02383359707891941,0,0
86+
0.9375891089439392,1,1
87+
0.173687145113945,0,0
88+
0.010432712733745575,0,0
89+
0.012280341237783432,0,0
90+
0.01214765664190054,0,0
91+
0.021430451422929764,0,0
92+
0.02130751870572567,0,0
93+
0.01448642835021019,0,0
94+
0.33926016092300415,0,0
95+
0.8004374504089355,1,1
96+
0.02790185995399952,0,0
97+
0.009141432121396065,0,0
98+
0.08957505971193314,0,0
99+
0.01588565483689308,0,1
100+
0.05796121433377266,0,0
101+
0.009536383673548698,0,0
102+
0.02328318916261196,0,0
103+
0.01862017624080181,0,0
104+
0.010983781889081001,0,0
105+
0.20590396225452423,0,0
106+
0.04787583276629448,0,0
107+
0.012769637629389763,0,0
108+
0.01733328215777874,0,0
109+
0.014626984484493732,0,0
110+
0.04056696221232414,0,0
111+
0.024252999573946,0,0
112+
0.29420602321624756,0,0
113+
0.011293184012174606,0,0
114+
0.037872012704610825,0,0
115+
0.012885545380413532,0,0
116+
0.015344665385782719,0,0
117+
0.017112910747528076,0,0
118+
0.7990730404853821,0,1
119+
0.023190177977085114,0,0
120+
0.04182670637965202,0,0
121+
0.011668640188872814,0,0
122+
0.02800237387418747,0,0
123+
0.00800767820328474,0,0
124+
0.014360695146024227,0,0
125+
0.047663189470767975,0,0
126+
0.5585709810256958,0,1
127+
0.021525222808122635,0,0
128+
0.01766141504049301,0,0
129+
0.0825851559638977,0,0
130+
0.03350501134991646,0,0
131+
0.03521304950118065,0,0
132+
0.015325749292969704,0,0
133+
0.011540049687027931,0,0
134+
0.5493990182876587,0,1
135+
0.02762889489531517,0,0
136+
0.007694609928876162,0,0
137+
0.018426047638058662,0,0
138+
0.04579944908618927,0,0
139+
0.02797023206949234,0,0
140+
0.06349072605371475,0,0
141+
0.02026795595884323,0,0
142+
0.9052221775054932,1,1
143+
0.016631130129098892,0,0
144+
0.008177604526281357,0,0
145+
0.010130000300705433,0,0
146+
0.016423864290118217,0,0
147+
0.028318187221884727,0,0
148+
0.013474663719534874,0,0
149+
0.019876541569828987,0,0
150+
0.964660108089447,1,1
151+
0.0077370535582304,0,0
152+
0.039300426840782166,0,0
153+
0.6636478900909424,0,1
154+
0.005737839266657829,0,0
155+
0.012539546005427837,0,0
156+
0.01009538397192955,0,0
157+
0.021373340860009193,0,0
158+
0.035544708371162415,0,0
159+
0.030450226739048958,0,0
160+
0.008851529099047184,0,0
161+
0.023025596514344215,0,0
162+
0.038430776447057724,0,0
163+
0.971492350101471,1,1
164+
0.03063318133354187,0,0
165+
0.004453285597264767,0,0
166+
0.030576691031455994,0,0
167+
0.04599585011601448,0,0
168+
0.9446926116943359,1,1
169+
0.018946733325719833,0,0
170+
0.026842299848794937,0,0
171+
0.025097539648413658,0,0
172+
0.025626109912991524,0,0
173+
0.01780521497130394,0,0
174+
0.1305849552154541,0,0
175+
0.021122287958860397,0,0
176+
0.01624421961605549,0,0
177+
0.05073343962430954,0,1
178+
0.02665840834379196,0,0
179+
0.03264984115958214,0,0
180+
0.02785848267376423,0,0
181+
0.9838100671768188,1,1
182+
0.14822255074977875,0,0
183+
0.9352473020553589,1,1
184+
0.01702801324427128,0,0
185+
0.013699215836822987,0,0
186+
0.8880519270896912,1,1
187+
0.22060361504554749,0,1
188+
0.02583867684006691,0,1
189+
0.01138597633689642,0,0
190+
0.0109474528580904,0,0
191+
0.013888617977499962,0,0
192+
0.17524825036525726,0,0
193+
0.004855007398873568,0,0
194+
0.02329222671687603,0,0
195+
0.17314553260803223,0,0
196+
0.01061172690242529,0,0
197+
0.02198977954685688,0,0
198+
0.014142796397209167,0,0
199+
0.034232206642627716,0,1
200+
0.06763304024934769,0,0
201+
0.0254181120544672,0,0
202+
0.07675473392009735,0,0

0 commit comments

Comments
 (0)