Module 8: neural networks with TensorFlow
{
"module": 8,
"framework": "TensorFlow 2.19.1",
"dataset": "UCI red wine quality",
"epochs_requested": 40,
"best_validation_epoch": 12,
"weight_change_norm": 2.9802293781333926,
"threshold": 0.05,
"baseline_threshold": 0.15,
"selection": "validation loss checkpoint; validation balanced accuracy threshold; patience 5",
"sample_rows": 1599,
"test": {
"n": 243,
"tp": 29,
"tn": 124,
"fp": 90,
"fn": 0,
"precision": 0.24369747899159663,
"recall": 1.0,
"specificity": 0.5794392523364486,
"selection_rate": 0.4897119341563786,
"fpr": 0.4205607476635514,
"balanced_accuracy": 0.7897196261682242,
"f1": 0.3918918918918919,
"roc_auc": 0.8907508862391235,
"pr_auc_average_precision": 0.4480572156550389
},
"linear_baseline": {
"n": 243,
"tp": 26,
"tn": 163,
"fp": 51,
"fn": 3,
"precision": 0.33766233766233766,
"recall": 0.896551724137931,
"specificity": 0.7616822429906542,
"selection_rate": 0.3168724279835391,
"fpr": 0.2383177570093458,
"balanced_accuracy": 0.8291169835642926,
"f1": 0.49056603773584906,
"roc_auc": 0.8788269416693522,
"pr_auc_average_precision": 0.4505106310884106
},
"saved_model_replay_verified": true,
"vocabulary_fitted_on": null
}Checkpoint selection uses validation loss with patience 5; each method selects its own threshold by validation balanced accuracy. Final labels never select weights or thresholds.
The learning-history table is the numerical alternative to a curve: compare training/validation loss and identify divergence without relying on a plotted line.
A small network may underperform the simpler baseline. These finite historical samples and small epoch budgets do not establish production readiness.
For NLP, text IDs replace raw messages in reports. Public messages can still contain personal content; processing is local.
Learning History
Download learning history (CSV)
| epoch | training_loss | validation_loss |
|---|---|---|
| 1 | 0.4585970625254677 | 0.37601742148399353 |
| 2 | 0.3193539623337696 | 0.33015918731689453 |
| 3 | 0.2929991282695948 | 0.3205799162387848 |
| 4 | 0.2824504669749033 | 0.313119500875473 |
| 5 | 0.2755743173452524 | 0.3115232586860657 |
| 6 | 0.2717164953727415 | 0.31114864349365234 |
| 7 | 0.26907549689195664 | 0.31134065985679626 |
| 8 | 0.264253573415531 | 0.30213338136672974 |
| 9 | 0.2623487911412029 | 0.3022264838218689 |
| 10 | 0.2600131929453882 | 0.3027192950248718 |
| 11 | 0.25842974469572144 | 0.3007720708847046 |
| 12 | 0.2576005861349737 | 0.2982282042503357 |
| 13 | 0.25553339367902345 | 0.30104559659957886 |
| 14 | 0.25279354158795586 | 0.3018098771572113 |
| 15 | 0.25307594023791535 | 0.30340877175331116 |
| 16 | 0.25235914315008734 | 0.30740898847579956 |
| 17 | 0.24964223330264015 | 0.3031314015388489 |
Validation Thresholds
Download validation thresholds (CSV)
| threshold | n | tp | tn | fp | fn | precision | recall | specificity | selection_rate | fpr | balanced_accuracy | f1 | method |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.05 | 238 | 33 | 125 | 79 | 1 | 0.29464285714285715 | 0.9705882352941176 | 0.6127450980392157 | 0.47058823529411764 | 0.3872549019607843 | 0.7916666666666667 | 0.4520547945205479 | neural |
| 0.1 | 238 | 28 | 148 | 56 | 6 | 0.3333333333333333 | 0.8235294117647058 | 0.7254901960784313 | 0.35294117647058826 | 0.27450980392156865 | 0.7745098039215685 | 0.4745762711864407 | neural |
| 0.2 | 238 | 23 | 177 | 27 | 11 | 0.46 | 0.6764705882352942 | 0.8676470588235294 | 0.21008403361344538 | 0.1323529411764706 | 0.7720588235294118 | 0.5476190476190477 | neural |
| 0.25 | 238 | 20 | 181 | 23 | 14 | 0.46511627906976744 | 0.5882352941176471 | 0.8872549019607843 | 0.18067226890756302 | 0.11274509803921569 | 0.7377450980392157 | 0.5194805194805194 | neural |
| 0.15 | 238 | 23 | 159 | 45 | 11 | 0.3382352941176471 | 0.6764705882352942 | 0.7794117647058824 | 0.2857142857142857 | 0.22058823529411764 | 0.7279411764705883 | 0.45098039215686275 | neural |
| 0.35 | 238 | 18 | 187 | 17 | 16 | 0.5142857142857142 | 0.5294117647058824 | 0.9166666666666666 | 0.14705882352941177 | 0.08333333333333333 | 0.7230392156862745 | 0.5217391304347826 | neural |
| 0.3 | 238 | 18 | 184 | 20 | 16 | 0.47368421052631576 | 0.5294117647058824 | 0.9019607843137255 | 0.15966386554621848 | 0.09803921568627451 | 0.7156862745098039 | 0.5 | neural |
| 0.4 | 238 | 13 | 191 | 13 | 21 | 0.5 | 0.38235294117647056 | 0.9362745098039216 | 0.1092436974789916 | 0.06372549019607843 | 0.6593137254901961 | 0.43333333333333335 | neural |
| 0.45 | 238 | 12 | 194 | 10 | 22 | 0.5454545454545454 | 0.35294117647058826 | 0.9509803921568627 | 0.09243697478991597 | 0.049019607843137254 | 0.6519607843137255 | 0.42857142857142855 | neural |
| 0.5 | 238 | 8 | 198 | 6 | 26 | 0.5714285714285714 | 0.23529411764705882 | 0.9705882352941176 | 0.058823529411764705 | 0.029411764705882353 | 0.6029411764705882 | 0.3333333333333333 | neural |
| 0.55 | 238 | 6 | 201 | 3 | 28 | 0.6666666666666666 | 0.17647058823529413 | 0.9852941176470589 | 0.037815126050420166 | 0.014705882352941176 | 0.5808823529411765 | 0.27906976744186046 | neural |
| 0.6 | 238 | 5 | 201 | 3 | 29 | 0.625 | 0.14705882352941177 | 0.9852941176470589 | 0.03361344537815126 | 0.014705882352941176 | 0.5661764705882353 | 0.23809523809523808 | neural |
| 0.65 | 238 | 4 | 202 | 2 | 30 | 0.6666666666666666 | 0.11764705882352941 | 0.9901960784313726 | 0.025210084033613446 | 0.00980392156862745 | 0.553921568627451 | 0.2 | neural |
| 0.7 | 238 | 3 | 204 | 0 | 31 | 1.0 | 0.08823529411764706 | 1.0 | 0.012605042016806723 | 0.0 | 0.5441176470588235 | 0.16216216216216217 | neural |
| 0.75 | 238 | 2 | 204 | 0 | 32 | 1.0 | 0.058823529411764705 | 1.0 | 0.008403361344537815 | 0.0 | 0.5294117647058824 | 0.1111111111111111 | neural |
| 0.8 | 238 | 1 | 204 | 0 | 33 | 1.0 | 0.029411764705882353 | 1.0 | 0.004201680672268907 | 0.0 | 0.5147058823529411 | 0.05714285714285714 | neural |
| 0.85 | 238 | 0 | 204 | 0 | 34 | nan | 0.0 | 1.0 | 0.0 | 0.0 | 0.5 | 0.0 | neural |
| 0.9 | 238 | 0 | 204 | 0 | 34 | nan | 0.0 | 1.0 | 0.0 | 0.0 | 0.5 | 0.0 | neural |
| 0.95 | 238 | 0 | 204 | 0 | 34 | nan | 0.0 | 1.0 | 0.0 | 0.0 | 0.5 | 0.0 | neural |
| 0.15 | 238 | 27 | 174 | 30 | 7 | 0.47368421052631576 | 0.7941176470588235 | 0.8529411764705882 | 0.23949579831932774 | 0.14705882352941177 | 0.8235294117647058 | 0.5934065934065934 | linear_baseline |
| 0.2 | 238 | 23 | 181 | 23 | 11 | 0.5 | 0.6764705882352942 | 0.8872549019607843 | 0.19327731092436976 | 0.11274509803921569 | 0.7818627450980392 | 0.575 | linear_baseline |
| 0.25 | 238 | 22 | 183 | 21 | 12 | 0.5116279069767442 | 0.6470588235294118 | 0.8970588235294118 | 0.18067226890756302 | 0.10294117647058823 | 0.7720588235294118 | 0.5714285714285714 | linear_baseline |
| 0.05 | 238 | 31 | 123 | 81 | 3 | 0.2767857142857143 | 0.9117647058823529 | 0.6029411764705882 | 0.47058823529411764 | 0.39705882352941174 | 0.7573529411764706 | 0.4246575342465753 | linear_baseline |
| 0.1 | 238 | 27 | 147 | 57 | 7 | 0.32142857142857145 | 0.7941176470588235 | 0.7205882352941176 | 0.35294117647058826 | 0.27941176470588236 | 0.7573529411764706 | 0.4576271186440678 | linear_baseline |
| 0.3 | 238 | 20 | 188 | 16 | 14 | 0.5555555555555556 | 0.5882352941176471 | 0.9215686274509803 | 0.15126050420168066 | 0.0784313725490196 | 0.7549019607843137 | 0.5714285714285714 | linear_baseline |
| 0.35 | 238 | 14 | 194 | 10 | 20 | 0.5833333333333334 | 0.4117647058823529 | 0.9509803921568627 | 0.10084033613445378 | 0.049019607843137254 | 0.6813725490196079 | 0.4827586206896552 | linear_baseline |
| 0.4 | 238 | 12 | 195 | 9 | 22 | 0.5714285714285714 | 0.35294117647058826 | 0.9558823529411765 | 0.08823529411764706 | 0.04411764705882353 | 0.6544117647058824 | 0.43636363636363634 | linear_baseline |
| 0.45 | 238 | 9 | 195 | 9 | 25 | 0.5 | 0.2647058823529412 | 0.9558823529411765 | 0.07563025210084033 | 0.04411764705882353 | 0.6102941176470589 | 0.34615384615384615 | linear_baseline |
| 0.5 | 238 | 8 | 196 | 8 | 26 | 0.5 | 0.23529411764705882 | 0.9607843137254902 | 0.06722689075630252 | 0.0392156862745098 | 0.5980392156862745 | 0.32 | linear_baseline |
| 0.55 | 238 | 7 | 198 | 6 | 27 | 0.5384615384615384 | 0.20588235294117646 | 0.9705882352941176 | 0.0546218487394958 | 0.029411764705882353 | 0.5882352941176471 | 0.2978723404255319 | linear_baseline |
| 0.6 | 238 | 6 | 201 | 3 | 28 | 0.6666666666666666 | 0.17647058823529413 | 0.9852941176470589 | 0.037815126050420166 | 0.014705882352941176 | 0.5808823529411765 | 0.27906976744186046 | linear_baseline |
| 0.65 | 238 | 3 | 203 | 1 | 31 | 0.75 | 0.08823529411764706 | 0.9950980392156863 | 0.01680672268907563 | 0.004901960784313725 | 0.5416666666666666 | 0.15789473684210525 | linear_baseline |
| 0.7 | 238 | 1 | 203 | 1 | 33 | 0.5 | 0.029411764705882353 | 0.9950980392156863 | 0.008403361344537815 | 0.004901960784313725 | 0.5122549019607843 | 0.05555555555555555 | linear_baseline |
| 0.75 | 238 | 1 | 203 | 1 | 33 | 0.5 | 0.029411764705882353 | 0.9950980392156863 | 0.008403361344537815 | 0.004901960784313725 | 0.5122549019607843 | 0.05555555555555555 | linear_baseline |
| 0.8 | 238 | 1 | 203 | 1 | 33 | 0.5 | 0.029411764705882353 | 0.9950980392156863 | 0.008403361344537815 | 0.004901960784313725 | 0.5122549019607843 | 0.05555555555555555 | linear_baseline |
| 0.85 | 238 | 0 | 204 | 0 | 34 | nan | 0.0 | 1.0 | 0.0 | 0.0 | 0.5 | 0.0 | linear_baseline |
| 0.9 | 238 | 0 | 204 | 0 | 34 | nan | 0.0 | 1.0 | 0.0 | 0.0 | 0.5 | 0.0 | linear_baseline |
| 0.95 | 238 | 0 | 204 | 0 | 34 | nan | 0.0 | 1.0 | 0.0 | 0.0 | 0.5 | 0.0 | linear_baseline |
Validation Predictions
Download validation predictions (CSV)
| actual | neural_probability | baseline_probability |
|---|---|---|
| 0.0 | 0.0035021170042455196 | 0.012322065204531819 |
| 0.0 | 0.011517436243593693 | 0.0182144186872803 |
| 0.0 | 0.006354234181344509 | 0.012905446718500493 |
| 0.0 | 0.0234639011323452 | 0.026358530053155936 |
| 0.0 | 0.046939071267843246 | 0.04240947563329314 |
| 0.0 | 0.009404653683304787 | 0.010993249920819594 |
| 0.0 | 0.007782170083373785 | 0.016077970585763712 |
| 0.0 | 0.07987724244594574 | 0.06693602207845431 |
| 0.0 | 0.07987724244594574 | 0.06693602207845431 |
| 0.0 | 0.010015659034252167 | 0.01575433879650999 |
| 0.0 | 0.0033509505447000265 | 0.010644750879596272 |
| 0.0 | 0.21130630373954773 | 0.13608823097009964 |
| 0.0 | 0.06167078763246536 | 0.057742848510842854 |
| 0.0 | 0.007884766906499863 | 0.01582329899113161 |
| 0.0 | 0.12727700173854828 | 0.09801707330355174 |
| 0.0 | 0.020424623042345047 | 0.027186673760517355 |
| 0.0 | 4.5034015784040093e-05 | 0.0007810585442137134 |
| 0.0 | 0.0035781769547611475 | 0.010714395379626963 |
| 0.0 | 0.0031135231256484985 | 0.010545415084702792 |
| 0.0 | 0.0029019745998084545 | 0.006542647632294432 |
| 0.0 | 0.07677625864744186 | 0.06366223892880184 |
| 0.0 | 0.0011177185224369168 | 0.04228046659602946 |
| 0.0 | 0.19693371653556824 | 0.06302931193270721 |
| 0.0 | 0.19693371653556824 | 0.06302931193270721 |
| 0.0 | 0.02558758296072483 | 0.00991525530777297 |
| 0.0 | 0.02590315043926239 | 0.009908519645807313 |
| 0.0 | 0.00807330384850502 | 0.019708935708745236 |
| 0.0 | 0.02802208811044693 | 0.03024518030676074 |
| 0.0 | 0.00807330384850502 | 0.019708935708745236 |
| 0.0 | 0.0028866061475127935 | 0.009567976745943575 |
| 0.0 | 0.005383170209825039 | 0.017612608233519275 |
| 1.0 | 0.44528186321258545 | 0.43015551861078766 |
| 0.0 | 0.006691184360533953 | 0.014735594490505953 |
| 0.0 | 0.006446135696023703 | 0.017194687871286425 |
| 0.0 | 0.006331585813313723 | 0.017041533783697223 |
| 0.0 | 0.01003341842442751 | 0.014775609253703123 |
| 0.0 | 0.10197266936302185 | 0.12260750257316595 |
| 0.0 | 0.0027021404821425676 | 0.00684215528234872 |
| 0.0 | 0.022147836163640022 | 0.026939710935042743 |
| 0.0 | 0.004387144930660725 | 0.015081028564630353 |
| 0.0 | 0.022147836163640022 | 0.026939710935042743 |
| 0.0 | 0.004877525847405195 | 0.013118554286273926 |
| 0.0 | 0.004608521703630686 | 0.012405027805671653 |
| 0.0 | 0.23386642336845398 | 0.10887021303004842 |
| 0.0 | 0.00961135420948267 | 0.01373948753964337 |
| 1.0 | 0.2665680944919586 | 0.6486661467267661 |
| 0.0 | 0.45907941460609436 | 0.525565115661617 |
| 0.0 | 0.08841680735349655 | 0.09095077293935626 |
| 0.0 | 0.005514433141797781 | 0.010836067237365934 |
| 0.0 | 0.0090663842856884 | 0.0131237399473058 |
| 1.0 | 0.11127305030822754 | 0.06918520644628072 |
| 1.0 | 0.37780725955963135 | 0.5936926218798713 |
| 0.0 | 0.19528840482234955 | 0.13679355689800904 |
| 0.0 | 0.19528840482234955 | 0.13679355689800904 |
| 0.0 | 0.005312405526638031 | 0.01101412452303932 |
| 0.0 | 0.6850231885910034 | 0.8049659541107871 |
| 1.0 | 0.05588165298104286 | 0.1721555604940145 |
| 0.0 | 0.10600783675909042 | 0.10441606408355701 |
| 0.0 | 0.3900292217731476 | 0.31448196784582244 |
| 0.0 | 0.621494472026825 | 0.6206940595100059 |
| 0.0 | 0.010553834028542042 | 0.03651491062588832 |
| 0.0 | 0.010553834028542042 | 0.03651491062588832 |
| 0.0 | 0.005341740790754557 | 0.027826228814174764 |
| 0.0 | 0.04531247541308403 | 0.03765659772550874 |
| 0.0 | 0.012507784180343151 | 0.02314767391649989 |
| 0.0 | 0.01708056963980198 | 0.025169422409476366 |
| 0.0 | 0.34597599506378174 | 0.1487234712072677 |
| 0.0 | 0.34597599506378174 | 0.1487234712072677 |
| 0.0 | 0.038720495998859406 | 0.09415960898001914 |
| 0.0 | 0.005917673464864492 | 0.016391339426732852 |
| 0.0 | 0.08204279839992523 | 0.14064556617030136 |
| 0.0 | 0.08204279839992523 | 0.14064556617030136 |
| 0.0 | 0.12888172268867493 | 0.197662944949589 |
| 0.0 | 0.12888172268867493 | 0.197662944949589 |
| 0.0 | 0.02192787081003189 | 0.022052936663885938 |
| 1.0 | 0.4810168147087097 | 0.3099538077722412 |
| 0.0 | 0.0029053569305688143 | 0.007609206572936037 |
| 0.0 | 0.024229250848293304 | 0.015274528557921517 |
| 0.0 | 0.005871752742677927 | 0.12222912949052818 |
| 0.0 | 0.008639882318675518 | 0.02651959819053785 |
| 0.0 | 0.0003017266863025725 | 0.004137509116121394 |
| 1.0 | 0.003435346996411681 | 0.009967908685361761 |
| 0.0 | 0.01475074514746666 | 0.034188485631235783 |
| 0.0 | 0.18574267625808716 | 0.1463236253768673 |
| 0.0 | 0.0023814316373318434 | 0.009582349255706597 |
| 0.0 | 0.0017487662844359875 | 0.008464253630090283 |
| 0.0 | 0.10708905011415482 | 0.1283788439022453 |
| 0.0 | 0.0034343625884503126 | 0.01341842758720627 |
| 0.0 | 0.002616072539240122 | 0.007581676921588815 |
| 0.0 | 0.0006928500952199101 | 0.003336024404518367 |
| 0.0 | 0.0020213432144373655 | 0.006469554301555468 |
| 0.0 | 0.0021143716294318438 | 0.010853856282567305 |
| 0.0 | 0.22979670763015747 | 0.12671147291686646 |
| 0.0 | 0.0791340246796608 | 0.10190890893032614 |
| 0.0 | 0.0025910085532814264 | 0.011423982497524238 |
| 0.0 | 0.0025910085532814264 | 0.011423982497524238 |
| 0.0 | 0.008036058396100998 | 0.0218607210426447 |
| 0.0 | 0.017916833981871605 | 0.015531416348966477 |
| 0.0 | 0.017916833981871605 | 0.015531416348966477 |
| 0.0 | 0.07943465560674667 | 0.0708381734160002 |
| 0.0 | 0.005524179898202419 | 0.009639999451122382 |
| 0.0 | 0.002328490372747183 | 0.005625325028458029 |
| 0.0 | 0.19301171600818634 | 0.13386608999786087 |
| 0.0 | 0.003313820343464613 | 0.013422350967165703 |
| 0.0 | 0.037302784621715546 | 0.025406656920421575 |
| 0.0 | 0.0013233970385044813 | 0.007987884979810025 |
| 0.0 | 0.0013233970385044813 | 0.007987884979810025 |
| 0.0 | 0.0017292030388489366 | 0.006494082615618975 |
| 0.0 | 0.0017292030388489366 | 0.006494082615618975 |
| 0.0 | 0.002635669196024537 | 0.007386277611437523 |
| 0.0 | 0.013721034862101078 | 0.02712763215673972 |
| 0.0 | 0.013721034862101078 | 0.02712763215673972 |
| 0.0 | 0.09193941205739975 | 0.0553602689382961 |
| 0.0 | 0.5444156527519226 | 0.6246769163311475 |
| 0.0 | 0.06387481093406677 | 0.061603311136077026 |
| 0.0 | 0.06387481093406677 | 0.061603311136077026 |
| 0.0 | 0.017473433166742325 | 0.025594058432658846 |
| 0.0 | 0.00349271553568542 | 0.006930558743644145 |
| 0.0 | 0.005054490640759468 | 0.01203735103693252 |
| 0.0 | 0.04884033277630806 | 0.04408756729360954 |
| 0.0 | 0.04884033277630806 | 0.04408756729360954 |
| 0.0 | 0.05138066038489342 | 0.04631517912538024 |
| 0.0 | 0.020554134622216225 | 0.01923663346595421 |
| 0.0 | 0.44893622398376465 | 0.4530290426337574 |
| 0.0 | 0.0024172738194465637 | 0.006196116297541796 |
| 0.0 | 0.0024172738194465637 | 0.006196116297541796 |
| 0.0 | 0.025981474667787552 | 0.051715659147358005 |
| 1.0 | 0.2304069846868515 | 0.320394902096559 |
| 0.0 | 0.1473160982131958 | 0.08509003353457016 |
| 0.0 | 0.031086483970284462 | 0.045003391337062285 |
| 1.0 | 0.07640024274587631 | 0.04161531345870984 |
| 1.0 | 0.07640024274587631 | 0.04161531345870984 |
| 0.0 | 0.18812471628189087 | 0.30587500828739506 |
| 1.0 | 0.3915539085865021 | 0.4727899476794753 |
| 0.0 | 0.18812471628189087 | 0.30587500828739506 |
| 0.0 | 0.056352049112319946 | 0.07838032378535789 |
| 1.0 | 0.6987305879592896 | 0.6144964419474843 |
| 0.0 | 0.38435789942741394 | 0.3804842575130433 |
| 1.0 | 0.37138280272483826 | 0.3455693765275158 |
| 1.0 | 0.3868798613548279 | 0.5018917707593971 |
| 0.0 | 0.005116814747452736 | 0.015252513632602504 |
| 0.0 | 0.005116814747452736 | 0.015252513632602504 |
| 0.0 | 0.19740179181098938 | 0.10006706582061389 |
| 0.0 | 0.19740179181098938 | 0.10006706582061389 |
| 1.0 | 0.14825306832790375 | 0.1709523496728728 |
| 1.0 | 0.14825306832790375 | 0.1709523496728728 |
| 0.0 | 0.0940917432308197 | 0.1237367345394764 |
| 0.0 | 0.460180401802063 | 0.5131365935178047 |
| 1.0 | 0.0943530797958374 | 0.0795260184722087 |
| 1.0 | 0.08617215603590012 | 0.06417885311178333 |
| 0.0 | 0.003949644509702921 | 0.008603297621416992 |
| 1.0 | 0.5308451652526855 | 0.30412171994025006 |
| 0.0 | 0.21487945318222046 | 0.20765430756237027 |
| 0.0 | 0.5264290571212769 | 0.5642845103242485 |
| 0.0 | 0.16449491679668427 | 0.15149478699565455 |
| 1.0 | 0.1087971031665802 | 0.20629545149140152 |
| 1.0 | 0.37142762541770935 | 0.34783233794444796 |
| 0.0 | 0.04073842242360115 | 0.02129795210648321 |
| 0.0 | 0.04073842242360115 | 0.02129795210648321 |
| 0.0 | 0.45463865995407104 | 0.30750684718368965 |
| 1.0 | 0.7313096523284912 | 0.6118992050705144 |
| 0.0 | 0.051634300500154495 | 0.07372752303579873 |
| 0.0 | 0.39668014645576477 | 0.2937080598957162 |
| 1.0 | 0.8441582918167114 | 0.8414590737796436 |
| 0.0 | 0.013936935923993587 | 0.024855038181656228 |
| 1.0 | 0.2211751937866211 | 0.37077390698077367 |
| 0.0 | 0.2901254892349243 | 0.25788223086205414 |
| 0.0 | 0.008002563379704952 | 0.01839646694278809 |
| 0.0 | 0.008002563379704952 | 0.01839646694278809 |
| 0.0 | 0.2528015673160553 | 0.1586006984599063 |
| 1.0 | 0.6282587647438049 | 0.6708190450572458 |
| 0.0 | 0.003536892356351018 | 0.009979191166196912 |
| 0.0 | 0.0004747983766719699 | 0.006810962338116206 |
| 0.0 | 0.0014957693638280034 | 0.00736918365046681 |
| 0.0 | 0.0018289460567757487 | 0.006689027040216144 |
| 0.0 | 0.5269288420677185 | 0.2796192710932797 |
| 1.0 | 0.4570114314556122 | 0.37000141761634897 |
| 1.0 | 0.23948071897029877 | 0.32456091399536474 |
| 0.0 | 0.4564197063446045 | 0.23321768432888107 |
| 0.0 | 0.18276210129261017 | 0.29740149397391613 |
| 0.0 | 0.4439149498939514 | 0.34704144530787195 |
| 0.0 | 0.4439149498939514 | 0.34704144530787195 |
| 0.0 | 0.6988953351974487 | 0.5921053742468345 |
| 0.0 | 0.001591249369084835 | 0.012254232876103454 |
| 0.0 | 0.0032636108808219433 | 0.00861095250063583 |
| 0.0 | 0.0032636108808219433 | 0.00861095250063583 |
| 0.0 | 0.0011351489229127765 | 0.005801487180178508 |
| 0.0 | 0.0008392279269173741 | 0.008061597404949751 |
| 0.0 | 0.024738293141126633 | 0.03691668277116856 |
| 0.0 | 0.07411448657512665 | 0.13234561213064874 |
| 0.0 | 0.06846435368061066 | 0.11912046146653262 |
| 1.0 | 0.5464798808097839 | 0.41003649747296594 |
| 0.0 | 0.004954086616635323 | 0.015526775552745805 |
| 0.0 | 0.004954086616635323 | 0.015526775552745805 |
| 0.0 | 0.004954086616635323 | 0.015526775552745805 |
| 0.0 | 0.014777748845517635 | 0.030400132206415853 |
| 0.0 | 0.07129497826099396 | 0.1090063190337212 |
| 0.0 | 0.13390693068504333 | 0.09178107686745467 |
| 0.0 | 0.005150259472429752 | 0.013408867532086657 |
| 0.0 | 0.005150259472429752 | 0.013408867532086657 |
| 0.0 | 0.007760087959468365 | 0.023500226021227383 |
| 0.0 | 0.007637524977326393 | 0.0077572926357567995 |
| 0.0 | 0.006303547415882349 | 0.03499209482085264 |
| 0.0 | 0.046305350959300995 | 0.09533480781654341 |
| 0.0 | 0.1797763854265213 | 0.13912902359597035 |
| 0.0 | 0.358874648809433 | 0.5601529609747498 |
| 0.0 | 0.11688047647476196 | 0.07541875703587206 |
| 1.0 | 0.12462238222360611 | 0.06509096712748022 |
| 1.0 | 0.4823736250400543 | 0.29721224913732236 |
| 0.0 | 0.004278523847460747 | 0.006470088480039118 |
| 1.0 | 0.4823736250400543 | 0.29721224913732236 |
| 1.0 | 0.27829810976982117 | 0.18322253068831967 |
| 0.0 | 0.03320065885782242 | 0.03659238895316615 |
| 0.0 | 0.006518070586025715 | 0.013734060478236682 |
| 0.0 | 0.3279671370983124 | 0.2638296110610744 |
| 0.0 | 0.056272927671670914 | 0.05813017011724847 |
| 1.0 | 0.7796331644058228 | 0.6771879200637175 |
| 0.0 | 0.020665913820266724 | 0.02733028618540747 |
| 0.0 | 0.2507963478565216 | 0.12142138687955097 |
| 0.0 | 0.009623480029404163 | 0.01595236934985564 |
| 0.0 | 0.013507187366485596 | 0.017742475265002833 |
| 0.0 | 0.06094193458557129 | 0.058098279712489265 |
| 0.0 | 0.1885230988264084 | 0.1747159566664683 |
| 0.0 | 0.1885230988264084 | 0.1747159566664683 |
| 0.0 | 0.08807919919490814 | 0.06434094062202232 |
| 0.0 | 0.05056167021393776 | 0.0354515198741872 |
| 0.0 | 0.18581797182559967 | 0.08787657512425502 |
| 0.0 | 0.014121330343186855 | 0.029051152427420138 |
| 0.0 | 0.11135389655828476 | 0.15016443631878762 |
| 1.0 | 0.5910001993179321 | 0.41536516935158124 |
| 0.0 | 0.0018479652935639024 | 0.006287772401542963 |
| 0.0 | 0.002022626344114542 | 0.00668366818503511 |
| 0.0 | 0.0034302789717912674 | 0.012557853065046276 |
| 0.0 | 0.0034302789717912674 | 0.012557853065046276 |
| 0.0 | 0.0034302789717912674 | 0.012557853065046276 |
| 0.0 | 0.1441875547170639 | 0.1261590494339805 |
| 0.0 | 0.17368347942829132 | 0.10090930694416184 |
| 0.0 | 0.17368347942829132 | 0.10090930694416184 |
Comparison
| method | n | tp | tn | fp | fn | precision | recall | specificity | selection_rate | fpr | balanced_accuracy | f1 | roc_auc | pr_auc_average_precision |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| neural | 243 | 29 | 124 | 90 | 0 | 0.24369747899159663 | 1.0 | 0.5794392523364486 | 0.4897119341563786 | 0.4205607476635514 | 0.7897196261682242 | 0.3918918918918919 | 0.8907508862391235 | 0.4480572156550389 |
| linear_baseline | 243 | 26 | 163 | 51 | 3 | 0.33766233766233766 | 0.896551724137931 | 0.7616822429906542 | 0.3168724279835391 | 0.2383177570093458 | 0.8291169835642926 | 0.49056603773584906 | 0.8788269416693522 | 0.4505106310884106 |
Test Predictions
Download test predictions (CSV)
| record_id | actual | probability | predicted |
|---|---|---|---|
| 17 | 0.0 | 0.0037205293774604797 | 0 |
| 20 | 0.0 | 0.015374773181974888 | 0 |
| 33 | 0.0 | 0.019914470613002777 | 0 |
| 35 | 0.0 | 0.027086498215794563 | 0 |
| 38 | 0.0 | 8.207577775465325e-05 | 0 |
| 57 | 0.0 | 0.018493259325623512 | 0 |
| 58 | 0.0 | 0.013765878044068813 | 0 |
| 69 | 0.0 | 0.189696803689003 | 1 |
| 86 | 0.0 | 0.022521603852510452 | 0 |
| 88 | 0.0 | 0.0292033888399601 | 0 |
| 89 | 0.0 | 0.0011962404241785407 | 0 |
| 90 | 0.0 | 0.002581002190709114 | 0 |
| 91 | 0.0 | 0.022521603852510452 | 0 |
| 98 | 0.0 | 0.0029383772052824497 | 0 |
| 100 | 0.0 | 0.022739585489034653 | 0 |
| 107 | 0.0 | 0.00844135694205761 | 0 |
| 108 | 0.0 | 0.090364009141922 | 1 |
| 111 | 0.0 | 0.007615621201694012 | 0 |
| 124 | 0.0 | 0.0018032094230875373 | 0 |
| 125 | 0.0 | 0.001437927014194429 | 0 |
| 129 | 0.0 | 0.020620260387659073 | 0 |
| 131 | 0.0 | 0.5206433534622192 | 1 |
| 132 | 0.0 | 0.5206433534622192 | 1 |
| 137 | 0.0 | 0.014479112811386585 | 0 |
| 145 | 0.0 | 0.0025534573942422867 | 0 |
| 160 | 0.0 | 0.001120196538977325 | 0 |
| 173 | 0.0 | 0.08822386711835861 | 1 |
| 177 | 0.0 | 0.058707330375909805 | 1 |
| 184 | 0.0 | 0.0027259669732302427 | 0 |
| 191 | 0.0 | 0.020305072888731956 | 0 |
| 195 | 0.0 | 0.003239438869059086 | 0 |
| 198 | 1.0 | 0.46247148513793945 | 1 |
| 199 | 0.0 | 0.0020245788618922234 | 0 |
| 208 | 0.0 | 0.022519178688526154 | 0 |
| 218 | 0.0 | 0.015043795108795166 | 0 |
| 220 | 0.0 | 0.018734363839030266 | 0 |
| 232 | 0.0 | 0.05669999495148659 | 1 |
| 255 | 0.0 | 0.005425387527793646 | 0 |
| 272 | 0.0 | 0.29775989055633545 | 1 |
| 280 | 0.0 | 0.34668222069740295 | 1 |
| 293 | 0.0 | 0.04410867765545845 | 0 |
| 296 | 0.0 | 0.004629190545529127 | 0 |
| 321 | 0.0 | 0.010634864680469036 | 0 |
| 336 | 0.0 | 0.6543471217155457 | 1 |
| 340 | 0.0 | 0.23079365491867065 | 1 |
| 344 | 0.0 | 0.14859043061733246 | 1 |
| 346 | 1.0 | 0.2812506854534149 | 1 |
| 347 | 0.0 | 0.6389007568359375 | 1 |
| 357 | 1.0 | 0.5773891806602478 | 1 |
| 380 | 0.0 | 0.09282758831977844 | 1 |
| 382 | 0.0 | 0.09282758831977844 | 1 |
| 383 | 0.0 | 0.09282758831977844 | 1 |
| 402 | 0.0 | 0.055007245391607285 | 1 |
| 404 | 0.0 | 0.0055106040090322495 | 0 |
| 411 | 0.0 | 0.0167817622423172 | 0 |
| 413 | 1.0 | 0.4787924885749817 | 1 |
| 426 | 0.0 | 0.04203924909234047 | 0 |
| 436 | 0.0 | 0.04501776769757271 | 0 |
| 437 | 0.0 | 0.43372616171836853 | 1 |
| 445 | 0.0 | 0.0046676648780703545 | 0 |
| 453 | 1.0 | 0.33753836154937744 | 1 |
| 455 | 1.0 | 0.41056907176971436 | 1 |
| 458 | 1.0 | 0.33753836154937744 | 1 |
| 462 | 0.0 | 0.46976813673973083 | 1 |
| 465 | 0.0 | 0.12331841886043549 | 1 |
| 467 | 0.0 | 0.7868561744689941 | 1 |
| 469 | 0.0 | 0.004126881714910269 | 0 |
| 470 | 0.0 | 0.13853572309017181 | 1 |
| 472 | 0.0 | 0.2911461591720581 | 1 |
| 482 | 0.0 | 0.17682220041751862 | 1 |
| 494 | 0.0 | 0.21616780757904053 | 1 |
| 524 | 0.0 | 0.016242848709225655 | 0 |
| 538 | 1.0 | 0.23720426857471466 | 1 |
| 548 | 0.0 | 0.2515275180339813 | 1 |
| 553 | 0.0 | 0.01625107042491436 | 0 |
| 557 | 0.0 | 0.06746885180473328 | 1 |
| 559 | 0.0 | 0.2005685269832611 | 1 |
| 561 | 0.0 | 0.007439058739691973 | 0 |
| 564 | 0.0 | 0.2005685269832611 | 1 |
| 598 | 0.0 | 0.007981989532709122 | 0 |
| 599 | 0.0 | 0.02521420083940029 | 0 |
| 623 | 0.0 | 0.3751698434352875 | 1 |
| 629 | 0.0 | 0.003548979526385665 | 0 |
| 631 | 0.0 | 0.05005134642124176 | 1 |
| 633 | 0.0 | 0.0039254180155694485 | 0 |
| 636 | 0.0 | 0.0002988070191349834 | 0 |
| 640 | 0.0 | 0.019834227859973907 | 0 |
| 642 | 0.0 | 0.019834227859973907 | 0 |
| 644 | 0.0 | 0.019834227859973907 | 0 |
| 645 | 1.0 | 0.0678364634513855 | 1 |
| 646 | 0.0 | 0.02597527578473091 | 0 |
| 664 | 0.0 | 0.048017580062150955 | 0 |
| 681 | 0.0 | 0.01946025714278221 | 0 |
| 684 | 0.0 | 0.00015601699124090374 | 0 |
| 686 | 0.0 | 0.003122558118775487 | 0 |
| 694 | 0.0 | 0.006530378013849258 | 0 |
| 699 | 0.0 | 0.2106737643480301 | 1 |
| 730 | 0.0 | 0.0005532504292204976 | 0 |
| 744 | 0.0 | 0.004192595835775137 | 0 |
| 750 | 0.0 | 0.00535498047247529 | 0 |
| 751 | 0.0 | 0.00535498047247529 | 0 |
| 753 | 0.0 | 0.00535498047247529 | 0 |
| 754 | 0.0 | 0.004729841370135546 | 0 |
| 766 | 0.0 | 0.00575868459418416 | 0 |
| 775 | 0.0 | 0.0009059276198968291 | 0 |
| 778 | 0.0 | 0.12468041479587555 | 1 |
| 790 | 0.0 | 0.06080671399831772 | 1 |
| 792 | 0.0 | 0.004349146503955126 | 0 |
| 803 | 0.0 | 0.011567149311304092 | 0 |
| 808 | 0.0 | 0.018836556002497673 | 0 |
| 838 | 1.0 | 0.6392144560813904 | 1 |
| 847 | 0.0 | 0.013929488137364388 | 0 |
| 861 | 0.0 | 0.04439058527350426 | 0 |
| 870 | 0.0 | 0.1871214359998703 | 1 |
| 877 | 0.0 | 0.1871214359998703 | 1 |
| 879 | 0.0 | 0.002328090602532029 | 0 |
| 883 | 0.0 | 0.002328090602532029 | 0 |
| 885 | 0.0 | 0.019074158743023872 | 0 |
| 886 | 0.0 | 0.012651531957089901 | 0 |
| 887 | 1.0 | 0.5498764514923096 | 1 |
| 894 | 0.0 | 0.0032731362152844667 | 0 |
| 899 | 0.0 | 0.0024921537842601538 | 0 |
| 903 | 1.0 | 0.11344955861568451 | 1 |
| 904 | 1.0 | 0.11344955861568451 | 1 |
| 918 | 0.0 | 0.28005167841911316 | 1 |
| 919 | 0.0 | 0.36602380871772766 | 1 |
| 921 | 0.0 | 0.28005167841911316 | 1 |
| 922 | 0.0 | 0.36602380871772766 | 1 |
| 925 | 1.0 | 0.19874972105026245 | 1 |
| 931 | 0.0 | 0.012697921134531498 | 0 |
| 932 | 0.0 | 0.011379244737327099 | 0 |
| 933 | 0.0 | 0.012697921134531498 | 0 |
| 948 | 1.0 | 0.5315173268318176 | 1 |
| 949 | 1.0 | 0.5315173268318176 | 1 |
| 950 | 1.0 | 0.5315173268318176 | 1 |
| 960 | 0.0 | 0.5176526308059692 | 1 |
| 961 | 0.0 | 0.011404312215745449 | 0 |
| 964 | 0.0 | 0.5176526308059692 | 1 |
| 982 | 0.0 | 0.5701802968978882 | 1 |
| 986 | 1.0 | 0.3260442316532135 | 1 |
| 987 | 0.0 | 0.0031834121327847242 | 0 |
| 1017 | 0.0 | 0.7282366752624512 | 1 |
| 1018 | 0.0 | 0.7282366752624512 | 1 |
| 1020 | 0.0 | 0.22728712856769562 | 1 |
| 1021 | 0.0 | 0.22728712856769562 | 1 |
| 1022 | 0.0 | 0.06949500739574432 | 1 |
| 1028 | 0.0 | 0.03470898047089577 | 0 |
| 1036 | 1.0 | 0.5588140487670898 | 1 |
| 1037 | 0.0 | 0.0007556437631137669 | 0 |
| 1038 | 1.0 | 0.5831727385520935 | 1 |
| 1053 | 1.0 | 0.7473722100257874 | 1 |
| 1056 | 1.0 | 0.3410757780075073 | 1 |
| 1059 | 1.0 | 0.3410757780075073 | 1 |
| 1072 | 0.0 | 0.008891466073691845 | 0 |
| 1073 | 0.0 | 0.08187257498502731 | 1 |
| 1077 | 0.0 | 0.2562278211116791 | 1 |
| 1078 | 0.0 | 0.2562278211116791 | 1 |
| 1088 | 1.0 | 0.19049692153930664 | 1 |
| 1089 | 1.0 | 0.19049692153930664 | 1 |
| 1102 | 0.0 | 0.07376310974359512 | 1 |
| 1135 | 0.0 | 0.3697412610054016 | 1 |
| 1142 | 0.0 | 0.4612368941307068 | 1 |
| 1145 | 0.0 | 0.0944158062338829 | 1 |
| 1146 | 0.0 | 0.043900374323129654 | 0 |
| 1149 | 0.0 | 0.2972634732723236 | 1 |
| 1151 | 0.0 | 0.5067542791366577 | 1 |
| 1158 | 0.0 | 0.1960858255624771 | 1 |
| 1172 | 0.0 | 0.6633695363998413 | 1 |
| 1177 | 1.0 | 0.4598551392555237 | 1 |
| 1178 | 0.0 | 0.049599308520555496 | 0 |
| 1184 | 0.0 | 0.046519458293914795 | 0 |
| 1188 | 0.0 | 0.046519458293914795 | 0 |
| 1195 | 0.0 | 0.00961768813431263 | 0 |
| 1197 | 0.0 | 0.025865858420729637 | 0 |
| 1200 | 0.0 | 0.025865858420729637 | 0 |
| 1203 | 0.0 | 0.0056059653870761395 | 0 |
| 1214 | 0.0 | 0.056637946516275406 | 1 |
| 1218 | 0.0 | 0.2867724895477295 | 1 |
| 1234 | 0.0 | 0.10295699536800385 | 1 |
| 1237 | 0.0 | 0.10295699536800385 | 1 |
| 1242 | 0.0 | 0.6455904841423035 | 1 |
| 1244 | 0.0 | 0.06057232618331909 | 1 |
| 1249 | 0.0 | 0.08401322364807129 | 1 |
| 1250 | 0.0 | 0.08401322364807129 | 1 |
| 1254 | 0.0 | 0.07548835128545761 | 1 |
| 1258 | 0.0 | 0.06301867961883545 | 1 |
| 1259 | 0.0 | 0.06301867961883545 | 1 |
| 1268 | 0.0 | 0.008890831843018532 | 0 |
| 1269 | 1.0 | 0.8130312561988831 | 1 |
| 1274 | 0.0 | 0.07597655057907104 | 1 |
| 1292 | 0.0 | 0.38460856676101685 | 1 |
| 1295 | 0.0 | 0.006459257565438747 | 0 |
| 1296 | 0.0 | 0.006459257565438747 | 0 |
| 1313 | 0.0 | 0.02785787731409073 | 0 |
| 1333 | 0.0 | 0.0027780947275459766 | 0 |
| 1339 | 0.0 | 0.03460823372006416 | 0 |
| 1340 | 0.0 | 0.03460823372006416 | 0 |
| 1341 | 0.0 | 0.03460823372006416 | 0 |
| 1343 | 0.0 | 0.03460823372006416 | 0 |
| 1350 | 0.0 | 0.023181205615401268 | 0 |
| 1356 | 0.0 | 0.017120715230703354 | 0 |
| 1360 | 0.0 | 0.06033637002110481 | 1 |
| 1370 | 0.0 | 0.0010103480890393257 | 0 |
| 1372 | 0.0 | 0.0010103480890393257 | 0 |
| 1375 | 0.0 | 0.006547616794705391 | 0 |
| 1382 | 0.0 | 0.004315132275223732 | 0 |
| 1383 | 0.0 | 0.004315132275223732 | 0 |
| 1385 | 0.0 | 0.0016359348082914948 | 0 |
| 1390 | 0.0 | 0.26850438117980957 | 1 |
| 1395 | 0.0 | 0.00741193350404501 | 0 |
| 1399 | 0.0 | 0.20750413835048676 | 1 |
| 1403 | 1.0 | 0.356085866689682 | 1 |
| 1418 | 0.0 | 0.010573334991931915 | 0 |
| 1420 | 0.0 | 0.010573334991931915 | 0 |
| 1428 | 0.0 | 0.0617702417075634 | 1 |
| 1431 | 0.0 | 0.026320433244109154 | 0 |
| 1436 | 0.0 | 0.000799523782916367 | 0 |
| 1438 | 0.0 | 0.013421496376395226 | 0 |
| 1447 | 0.0 | 0.013379737734794617 | 0 |
| 1449 | 1.0 | 0.5072913765907288 | 1 |
| 1453 | 0.0 | 0.0041235401295125484 | 0 |
| 1457 | 0.0 | 0.0041235401295125484 | 0 |
| 1464 | 0.0 | 0.01765412464737892 | 0 |
| 1465 | 0.0 | 0.01765412464737892 | 0 |
| 1478 | 0.0 | 0.020090917125344276 | 0 |
| 1487 | 0.0 | 0.14119037985801697 | 1 |
| 1488 | 0.0 | 0.07642950862646103 | 1 |
| 1491 | 0.0 | 0.07642950862646103 | 1 |
| 1492 | 0.0 | 0.10578399896621704 | 1 |
| 1503 | 0.0 | 0.1393996775150299 | 1 |
| 1505 | 0.0 | 0.00809437781572342 | 0 |
| 1529 | 0.0 | 0.020955782383680344 | 0 |
| 1532 | 0.0 | 0.10007946193218231 | 1 |
| 1538 | 0.0 | 0.1196611151099205 | 1 |
| 1540 | 0.0 | 0.15174251794815063 | 1 |
| 1548 | 0.0 | 0.07420697063207626 | 1 |
| 1558 | 0.0 | 0.0027329176664352417 | 0 |
| 1570 | 0.0 | 0.5443218350410461 | 1 |
| 1577 | 0.0 | 0.1162257269024849 | 1 |
| 1580 | 0.0 | 0.35639381408691406 | 1 |
| 1586 | 0.0 | 0.41229838132858276 | 1 |
| 1594 | 0.0 | 0.023402756080031395 | 0 |
| 1595 | 0.0 | 0.15505284070968628 | 1 |