Module 12: deployment and monitoring

{
  "module": 12,
  "real_heldout_rows": 243,
  "batches": 4,
  "model": "logistic",
  "threshold": 0.3,
  "replay_order": "source record order, not a measured event-time stream",
  "labels": "Offline known labels for delayed-outcome monitoring rehearsal",
  "monitoring": "Measured duration, input statistics, and outcome metrics; no fabricated telemetry"
}

Batches contain actual held-out records. Dataset order is not a temporal sequence; batch differences are not evidence of time drift.

Measured local durations depend on hardware/warm-up and are not production latency guarantees.

A mean-shift diagnostic prompts investigation; it does not prove concept drift. Operational use needs privacy, ownership, delayed labels, and rollback.

The Streamlit app uses this checked inference function and a local-LLM form that rejects invalid output schemas.

Batch Monitoring

Download batch monitoring (CSV)

batch monitoring
batchrowsmean_prediction_secondslargest_standardized_mean_shiftstandardized_shift_unavailablentptnfpfnprecisionrecallspecificityselection_ratefprbalanced_accuracyf1
1610.00107568145901242420.3915279686041067761250630.250.40.89285714285714290.131147540983606560.107142857142857140.64642857142857150.3076923076923077
2610.00106671518031242920.601945826559518761449620.40.66666666666666660.89090909090909090.163934426229508180.109090909090909090.77878787878787880.5
3610.0010650785245914330.68557889770968336111321440.440.73333333333333330.69565217391304350.40983606557377050.304347826086956540.71449275362318840.55
4600.00111984841666223170.636095998904915160253410.33333333333333330.66666666666666660.92982456140350880.10.070175438596491220.79824561403508780.4444444444444444

Prediction Log

Download prediction log (CSV)

prediction log
record_idbatchactualpredictedprobabilityprediction_seconds
171000.0146517705376671280.0011704859998644679
201000.0538614449253352960.0011026189999938651
331000.0133629164181116470.0010800350000863546
351000.01198302644305890.0010883120000926283
381000.00172058743738347010.0010990620000939089
571000.014146892794972240.0010745759998371796
581000.019305548921941370.001107566999962728
691000.10567445402229420.0010627629999362398
861010.59287897444500930.0010680130001219368
881000.151135922122982850.001072801999953299
891000.0049308065648485520.0012388229999942268
901000.0121975279060705120.0010751859999800217
911010.59287897444500930.0010635240000738122
981000.009287046401852760.0010643470000104571
1001000.0281215008300415880.001103771000089182
1071000.0120086708204209960.0010810379999384168
1081000.055832438473877490.0010809379998590884
1111000.017533247075484090.0010814980000759533
1241000.0105230571805748390.001076327999953719
1251000.007632767287666810.0010846440000022994
1291000.022804267291826820.001061591000052431
1311000.241633784773978980.0010756480000964075
1321000.241633784773978980.001075868000043556
1371000.019070138454440910.001056070999993608
1451000.0078977809312950550.0010998519999247947
1601000.0071539741398784350.0010846539998965454
1731000.070697351957317380.0010630130000208737
1771000.039157310806955140.0010734540001067217
1841000.0066122363464033280.0010547289998612541
1911000.0230888617939516150.0010962660001041513
1951000.0090351501729836440.0010752270000011777
1981100.251593661659614940.001096245999860912
1991000.0163092340691367650.0010795649998271983
2081000.021348446356545910.001064527000153248
2181000.0243238922320418960.001095403999897826
2201000.034865168414115020.0011585130000639765
2321000.037253096416669880.0010594970001420734
2551000.0107957892541567530.0010766100001546874
2721000.162297925073948250.001056871999935538
2801000.205243747875014370.0010632539999733126
2931000.042814453029994440.001077359999953842
2961000.017276174296590220.0010566519999883894
3211000.0132272747399341880.0010389890001079038
3361010.60978126209675960.0010609700000259181
3401010.349388442592414640.0010427950001030695
3441000.130568340058020340.0010532149999562535
3461100.188015188630772020.0010366139999860025
3471010.76903101065051890.001069807000021683
3571110.41611053231219880.0010590459999093582
3801000.09052396662078070.0010484260001248913
3821000.09052396662078070.001080286999922464
3831000.09052396662078070.0010567819999778294
4021000.094687612481566060.0010473740001089027
4041000.0098689264899980860.0010446490000504127
4111000.0220531318637985220.0010580549999303912
4131110.481024361798543240.0010410720001345908
4261000.052233916929295980.0010476749998815649
4361000.039931437914217130.001054507999924681
4371010.304563182780483330.001071509999974296
4451000.0163779089966302230.0010515919998397294
4531100.248614186166494580.0010759979998056224
4552110.64756482025762140.00108654799987562
4582100.248614186166494580.0010668109998732689
4622010.52203999208006550.0011684109999805514
4652000.094196708318001980.001087690000076691
4672010.85995491205790550.0010467539998444408
4692000.0230576704166539430.0010652780001692008
4702000.21762531342659070.0010509010000987473
4722000.253417887188477630.0010551889999987907
4822000.150062556987701380.001051060999998299
4942010.309466166757528250.0010488780001196574
5242000.0278354519738315920.0010685839999950986
5382110.468615190800338140.001048145999902772
5482000.22078273017166340.0010751669999535807
5532000.024591703585564190.0010597579998830042
5572000.22763590669692740.0010435980000238487
5592010.38315493389555240.0010357329999806097
5612000.0167779487265279840.001072440999905666
5642010.38315493389555240.0010691150000639027
5982000.0196270287520635860.0010435570000026928
5992000.056769437334760580.0010477850000825129
6232010.3612392488341950.0010541169999669364
6292000.00798587885811550.001051842999913788
6312000.067611441967035820.0010526539999773377
6332000.0134497249425846770.001050098999940019
6362000.0041149437181348940.0010653979998096474
6402000.026961522678757740.0010608400000364782
6422000.026961522678757740.0010518620001676027
6442000.026961522678757740.001090877000024193
6452100.0287966803808924580.0011019270000360848
6462000.01798167598319780.0010869689999708498
6642000.096245832159291180.0011007040000095003
6812000.039164355412107380.0010740249999798834
6842000.00304209671334667450.0010565919999407924
6862000.0084485866708122560.0010639160000209813
6942000.0135692988529333060.0010514020000300661
6992000.23420321922990040.0010599279999041755
7302000.003576399097591880.0011081080001531518
7442000.0207245002306936030.0010905049998655159
7502000.0106190875622542270.0010581149999779882
7512000.0106190875622542270.0011128280000320956
7532000.0106190875622542270.0010597979999147356
7542000.0080715020507515780.001048345999834055
7662000.0123043993166474140.0010543280000092636
7752000.0053863873885639350.0011691730001075484
7782000.062874375374273620.0010565019999830838
7902000.0358213514652648770.0010463819999131374
7922000.0081201091087239470.0010473539998656634
8032000.015819621076967380.001070677999905456
8082000.016862807098975490.0010627429999203741
8382110.419335582629387860.0010719209999479062
8472000.0164340729313495120.0010639750000791537
8612000.0445027835406426460.0010581139999885636
8702000.146989472856646570.0010502200000246376
8772000.146989472856646570.0010623219998251443
8792000.0065253219999337560.0010678930000267428
8832000.0065253219999337560.0010469239998656121
8852000.026488063969995110.0010980690001360927
8862000.0224154394453948860.0010550090000833734
8872110.58886328271678390.001040201000023444
8942000.0076571002558043980.001054437999982838
8992000.0094151527659644110.0010511220000353205
9033100.078535307050388260.0010740439997789508
9043100.078535307050388260.0010660399998414505
9183000.167017662089569220.0010336790001019835
9193010.36463372853612340.0010324459999537794
9213000.167017662089569220.0011190889999852516
9223010.36463372853612340.0010512920000564918
9253110.432761124697396140.0010538869998981681
9313000.0158129257096021530.0010495589999663935
9323000.023159179398606860.001069626999878892
9333000.0158129257096021530.001079295000181446
9483110.63795796543445590.001058504999946308
9493110.63795796543445590.0010517929999878106
9503110.63795796543445590.0010513209999771789
9603010.33977376893513440.001050028999998176
9613000.0184509524483739350.0010437470000397298
9643010.33977376893513440.0010371050000230753
9823010.59455142989093970.0010704879998684191
9863110.37240542983009730.0010327270001653233
9873000.0156212838771191860.00106547799987311
10173010.70506547971426860.0010256430000481487
10183010.70506547971426860.0010964470000089932
10203010.39917491921264040.001067582000132461
10213010.39917491921264040.001046823000024233
10223000.0470856226359061060.0010679629999685858
10283000.051878279872336310.0010417240000606398
10363110.53774968218102910.0010402410000551754
10373000.0040798154755550540.0010539360000620945
10383110.72348603367863870.0010366839999278454
10533110.71678066734327470.0010319950001758116
10563110.342842689399181330.001040381999928286
10593110.342842689399181330.0011209229999167292
10723000.022188576518145650.0010816589999649295
10733000.0423642880169860860.0010394500000074913
10773000.204450217702032750.0010676020001483266
10783000.204450217702032750.0010555300000305579
10883100.183713483515843430.0010563119999460469
10893100.183713483515843430.0010795449998113327
11023000.081664048864663330.0012086180001915636
11353010.400304978436367030.0010678629998892575
11423000.276018112779970.0010667510000530456
11453000.23679206810358530.001081467999938468
11463000.0363510028171565160.0010462130001087644
11493010.434860470704930.0010518519998186093
11513000.26684443434767670.0010601490000681224
11583010.352848426453129970.0010515620001569914
11723010.52391326664387960.001066509999873233
11773110.381048190063410950.001068443999884039
11783000.0507071464151607750.001053275999993275
11843000.0340420014578509750.001040622000118674
11883000.0340420014578509750.0010458520000611315
11953000.0165453534625241320.0010963160000301286
11973000.041358366393156450.0010660299999472045
12003000.041358366393156450.0010759580000012647
12033000.0124123246031722780.0011089499998888641
12143000.144883149917579140.001094533000014053
12183000.13053658007675390.0011296889999812265
12343000.19666177903984980.0010746760001438815
12373000.19666177903984980.0010894030001509236
12423010.5060477274565740.0010807470000600006
12443000.098835012716662670.0010483659998499206
12493000.062629999158737130.0010553500001151406
12504000.062629999158737130.0015129579999211273
12544000.0555154254302924340.0013389109999479842
12584000.048239583406918280.0011884489999829384
12594000.048239583406918280.0011312809999708406
12684000.0191118011981115040.0012344059998667944
12694110.77198169354311010.0010863069999231811
12744000.081589288683843160.0011024980001366202
12924010.36770485367736250.0010731929999110434
12954000.0106277576427694260.00109337100002449
12964000.0106277576427694260.0010583549999410025
13134000.037196195993014410.0010423650001030182
13334000.0103702132384135890.0010388580001290393
13394000.0420391458351836650.0030238619999636285
13404000.0420391458351836650.0011349589999554155
13414000.0420391458351836650.0011296689999653609
13434000.0420391458351836650.0010902049998549046
13504000.036408585169691720.0011008349999883649
13564000.031846260594006090.001110073000063494
13604000.0619278790734799840.0010816290000548179
13704000.005511321289804950.0011114349999843398
13724000.005511321289804950.0010679229999368545
13754000.0133211261181173590.0010650970000369853
13824000.0137987412155776560.0010522140000830404
13834000.0137987412155776560.001045762000103423
13854000.0053953964210568630.001184031000093455
13904000.26879689342111210.00109173800001372
13954000.0159643127929152560.0010798749999594293
13994000.08138429410083710.001144075999945926
14034100.29095821259535790.001073513000164894
14184000.024131313827559760.0010804370001551433
14204000.024131313827559760.0010453599998072605
14284000.055183432170878750.0010450600000240229
14314000.033058910975683710.0010683030000109284
14364000.006916389926679750.0010626830001001508
14384000.0238884716233774520.0010512110000036046
14474000.0165542671295938920.0010481369999979506
14494110.319371861603826750.0010623019998092786
14534000.0111656314112563330.0010511919999771635
14574000.0111656314112563330.0010639549998359144
14644000.026968411877875470.0010434880000502744
14654000.026968411877875470.001073472999905789
14784000.0099398267871390770.0010630740000578953
14874000.064027458931158880.0010554400000728492
14884000.087484830648859150.0010429259998545604
14914000.087484830648859150.0010494089999610878
14924000.123555478499058670.0010482760001195857
15034000.11982192533624740.0010382170000866608
15054000.0146522124479514640.0010396999998647516
15294000.027745037680300320.0010647670001162624
15324000.055205860291893150.0010445289999552188
15384000.099773138704901360.0010534359998928267
15404000.096529824349537820.0010576639999726467
15484000.1132451919667060.0010940520000985998
15584000.0041980624711205950.0010579539998616383
15704010.38064341184994140.0010708879999583587
15774000.088658603264810760.001041112999928373
15804010.312502466872960070.0010470130000612698
15864010.45044586989957260.0010416540001187968
15944000.032527079014804270.0010466640001141059
15954000.119779029458765490.0010506799999348004