Module 13: ethics and fairness across the lifecycle

{
  "module": 13,
  "dataset": "UCI Adult historic census extract",
  "train_rows": 26029,
  "validation_rows": 6508,
  "test_rows": 16253,
  "selected_threshold": 0.3,
  "features": [
    "age",
    "education_num",
    "capital_gain",
    "capital_loss",
    "hours_per_week"
  ],
  "audited_sex_race_used_for_fitting": false,
  "overall": {
    "n": 16253,
    "tp": 2394,
    "tn": 10366,
    "fp": 2045,
    "fn": 1448,
    "precision": 0.5393106555530525,
    "recall": 0.6231129619989588,
    "specificity": 0.8352268149222464,
    "selection_rate": 0.27311880883529194,
    "fpr": 0.1647731850777536,
    "balanced_accuracy": 0.7291698884606026,
    "f1": 0.5781910397295013
  },
  "interpretation": "Descriptive audit of a historical income-label task, not a decision rule for people."
}

Historical income is not a measure of merit, need, or a justified allocation outcome. Do not deploy this model for eligibility or targeting.

The source records limited sex/race categories. They do not capture identity, intersectional experience, or all affected groups. Differences are descriptive, not causal findings.

Excluding protected columns does not remove proxy effects or label bias. A metric does not establish fairness or legal compliance.

Interval columns are 95% Wilson illustrations conditional on independent binomial sampling, which this historical extract does not establish. They are not population confidence claims. Undefined rates and intervals remain unavailable; small-denominator flags use each rate denominator below 30. Interval overlap is not a test of group differences.

Validation Thresholds

Download validation thresholds (CSV)

validation thresholds
thresholdntptnfpfnprecisionrecallspecificityselection_ratefprbalanced_accuracyf1
0.36508100641587825620.56263982102908270.64158163265306120.84170040485829960.274738783036263030.158299595141700420.74164101875568030.599523241954708
0.5650863646982429320.7243735763097950.405612244897959160.95101214574898780.134910878918254460.0489878542510121460.67831219532347350.5200327064595257
0.7650836848766412000.85185185185185190.234693877551020420.98704453441295550.066379840196681010.0129554655870445340.61086920598198790.368

Group Audit

Download group audit (CSV)

group audit
attributerecorded_groupntptnfpfnprecisionrecallspecificityselection_ratefprbalanced_accuracyf1recall_denominatorrecall_illustrative_lowrecall_illustrative_highrecall_small_denominatorfpr_denominatorfpr_illustrative_lowfpr_illustrative_highfpr_small_denominatorselection_rate_denominatorselection_rate_illustrative_lowselection_rate_illustrative_highselection_rate_small_denominator
sexFemale541435741187062330.335841956726246450.60508474576271190.8536484245439470.196342814924270410.146351575456053070.72936658515332940.43194192377495465900.5650827716582790.6437271693759False48240.13665866294256450.1566072760691412False54140.185978554371445250.20713768481882042False
sexMale1083920376248133912150.60337677725118490.62638376383763840.82351390536443910.31146784758741580.176486094635560840.72494883460103880.614665057332528632520.60961709498911410.6428522007049516False75870.168072071962727170.18522755540656088False108390.302817823089531260.32025146040762714False
raceAmer-Indian-Eskimo159812218110.30769230769230770.421052631578947350.87142857142857140.163522012578616340.128571428571428560.64624060150375940.35555555555555557190.231418912824542470.6372409646574495True1400.082897890185975530.19408385865987404False1590.114103420046426680.2288157556051594False
raceAsian-Pac-Islander4798925888440.50282485875706220.66917293233082710.74566473988439310.36951983298538620.25433526011560690.70741883610761010.57419354838709681330.58544777433449090.7433999329890938False3460.211319243848685750.3027463543995456False4790.32749271092201830.4136231404274006False
raceBlack15611051213169740.383211678832116760.58659217877094970.8777134587554270.17552850736707240.122286541244573080.73215281876318830.463576158940397331790.51337108148120070.6561747108130982False13820.106053064238889240.14061401058768586False15610.157459811183312070.19519026445858492False
raceOther135151046100.71428571428571430.60.94545454545454540.155555555555555560.054545454545454540.77272727272727270.6521739130434783250.407394573589670.7659669762225203True1100.0252358270511034780.11391786075998825False1350.104050967243932260.22612028859036265False
raceWhite1391921778669176413090.55239786856127880.62449799196787150.83092111569059710.28313815647675840.169078884309402850.72770955382923430.58623939679547634860.60829402786200690.6404278726146179False104330.16200867319607880.17639269782750416False139190.27571431512990870.29068166676390855False