
ML / NLP / MODEL EVALUATION
COMPLETED V1–V2 STUDYFinancial Complaint Auto-Routing with NLP
Leakage-safe machine learning and NLP study for eight-class CFPB complaint classification, comparing a locked TF-IDF + Linear SVM benchmark with a frozen DistilBERT challenger and human-in-the-loop routing.
- Identified and remediated 39.39% normalized-text leakage in the original test split; corrected group-aware development/final-test splits achieved zero normalized-text overlap.
- On the shared 2024 benchmark, the frozen DistilBERT challenger increased Macro F1 from 0.7671 to 0.7949; both frozen models were later compared on a 30,156-row retrospective 2025 cohort.







