Module 13: ethics and fairness across the lifecycle
{
"module": 13,
"dataset": "UCI Adult historic census extract",
"train_rows": 26029,
"validation_rows": 6508,
"test_rows": 16253,
"selected_threshold": 0.3,
"features": [
"age",
"education_num",
"capital_gain",
"capital_loss",
"hours_per_week"
],
"audited_sex_race_used_for_fitting": false,
"overall": {
"n": 16253,
"tp": 2394,
"tn": 10366,
"fp": 2045,
"fn": 1448,
"precision": 0.5393106555530525,
"recall": 0.6231129619989588,
"specificity": 0.8352268149222464,
"selection_rate": 0.27311880883529194,
"fpr": 0.1647731850777536,
"balanced_accuracy": 0.7291698884606026,
"f1": 0.5781910397295013
},
"interpretation": "Descriptive audit of a historical income-label task, not a decision rule for people."
}Historical income is not a measure of merit, need, or a justified allocation outcome. Do not deploy this model for eligibility or targeting.
The source records limited sex/race categories. They do not capture identity, intersectional experience, or all affected groups. Differences are descriptive, not causal findings.
Excluding protected columns does not remove proxy effects or label bias. A metric does not establish fairness or legal compliance.
Interval columns are 95% Wilson illustrations conditional on independent binomial sampling, which this historical extract does not establish. They are not population confidence claims. Undefined rates and intervals remain unavailable; small-denominator flags use each rate denominator below 30. Interval overlap is not a test of group differences.
Validation Thresholds
Download validation thresholds (CSV)
| threshold | n | tp | tn | fp | fn | precision | recall | specificity | selection_rate | fpr | balanced_accuracy | f1 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.3 | 6508 | 1006 | 4158 | 782 | 562 | 0.5626398210290827 | 0.6415816326530612 | 0.8417004048582996 | 0.27473878303626303 | 0.15829959514170042 | 0.7416410187556803 | 0.599523241954708 |
| 0.5 | 6508 | 636 | 4698 | 242 | 932 | 0.724373576309795 | 0.40561224489795916 | 0.9510121457489878 | 0.13491087891825446 | 0.048987854251012146 | 0.6783121953234735 | 0.5200327064595257 |
| 0.7 | 6508 | 368 | 4876 | 64 | 1200 | 0.8518518518518519 | 0.23469387755102042 | 0.9870445344129555 | 0.06637984019668101 | 0.012955465587044534 | 0.6108692059819879 | 0.368 |
Group Audit
| attribute | recorded_group | n | tp | tn | fp | fn | precision | recall | specificity | selection_rate | fpr | balanced_accuracy | f1 | recall_denominator | recall_illustrative_low | recall_illustrative_high | recall_small_denominator | fpr_denominator | fpr_illustrative_low | fpr_illustrative_high | fpr_small_denominator | selection_rate_denominator | selection_rate_illustrative_low | selection_rate_illustrative_high | selection_rate_small_denominator |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sex | Female | 5414 | 357 | 4118 | 706 | 233 | 0.33584195672624645 | 0.6050847457627119 | 0.853648424543947 | 0.19634281492427041 | 0.14635157545605307 | 0.7293665851533294 | 0.4319419237749546 | 590 | 0.565082771658279 | 0.6437271693759 | False | 4824 | 0.1366586629425645 | 0.1566072760691412 | False | 5414 | 0.18597855437144525 | 0.20713768481882042 | False |
| sex | Male | 10839 | 2037 | 6248 | 1339 | 1215 | 0.6033767772511849 | 0.6263837638376384 | 0.8235139053644391 | 0.3114678475874158 | 0.17648609463556084 | 0.7249488346010388 | 0.6146650573325286 | 3252 | 0.6096170949891141 | 0.6428522007049516 | False | 7587 | 0.16807207196272717 | 0.18522755540656088 | False | 10839 | 0.30281782308953126 | 0.32025146040762714 | False |
| race | Amer-Indian-Eskimo | 159 | 8 | 122 | 18 | 11 | 0.3076923076923077 | 0.42105263157894735 | 0.8714285714285714 | 0.16352201257861634 | 0.12857142857142856 | 0.6462406015037594 | 0.35555555555555557 | 19 | 0.23141891282454247 | 0.6372409646574495 | True | 140 | 0.08289789018597553 | 0.19408385865987404 | False | 159 | 0.11410342004642668 | 0.2288157556051594 | False |
| race | Asian-Pac-Islander | 479 | 89 | 258 | 88 | 44 | 0.5028248587570622 | 0.6691729323308271 | 0.7456647398843931 | 0.3695198329853862 | 0.2543352601156069 | 0.7074188361076101 | 0.5741935483870968 | 133 | 0.5854477743344909 | 0.7433999329890938 | False | 346 | 0.21131924384868575 | 0.3027463543995456 | False | 479 | 0.3274927109220183 | 0.4136231404274006 | False |
| race | Black | 1561 | 105 | 1213 | 169 | 74 | 0.38321167883211676 | 0.5865921787709497 | 0.877713458755427 | 0.1755285073670724 | 0.12228654124457308 | 0.7321528187631883 | 0.46357615894039733 | 179 | 0.5133710814812007 | 0.6561747108130982 | False | 1382 | 0.10605306423888924 | 0.14061401058768586 | False | 1561 | 0.15745981118331207 | 0.19519026445858492 | False |
| race | Other | 135 | 15 | 104 | 6 | 10 | 0.7142857142857143 | 0.6 | 0.9454545454545454 | 0.15555555555555556 | 0.05454545454545454 | 0.7727272727272727 | 0.6521739130434783 | 25 | 0.40739457358967 | 0.7659669762225203 | True | 110 | 0.025235827051103478 | 0.11391786075998825 | False | 135 | 0.10405096724393226 | 0.22612028859036265 | False |
| race | White | 13919 | 2177 | 8669 | 1764 | 1309 | 0.5523978685612788 | 0.6244979919678715 | 0.8309211156905971 | 0.2831381564767584 | 0.16907888430940285 | 0.7277095538292343 | 0.586239396795476 | 3486 | 0.6082940278620069 | 0.6404278726146179 | False | 10433 | 0.1620086731960788 | 0.17639269782750416 | False | 13919 | 0.2757143151299087 | 0.29068166676390855 | False |