Machine Learning for Credit Scoring: Improving Logistic Regression with Non Linear Decision Tree Effects - HAL-SHS - Sciences de l'Homme et de la Société Accéder directement au contenu
Article Dans Une Revue European Journal of Operational Research Année : 2022

Machine Learning for Credit Scoring: Improving Logistic Regression with Non Linear Decision Tree Effects

Elena Ivona Dumitrescu
  • Fonction : Auteur
  • PersonId : 1108946
Sullivan Hué
  • Fonction : Auteur
  • PersonId : 1122778
Christophe Hurlin
Sessi Tokpavi

Résumé

In the context of credit scoring, ensemble methods based on decision trees, such as the random forest method, provide better classification performance than standard logistic regression models. However, logistic regression remains the benchmark in the credit risk industry mainly because the lack of interpretability of ensemble methods is incompatible with the requirements of financial regulators. In this paper, we propose a high-performance and interpretable credit scoring method called penalised logistic tree regression (PLTR), which uses information from decision trees to improve the performance of logistic regression. Formally, rules extracted from various short-depth decision trees built with original predictive variables are used as predictors in a penalised logistic regression model. PLTR allows us to capture non-linear effects that can arise in credit scoring data while preserving the intrinsic interpretability of the logistic regression model. Monte Carlo simulations and empirical applications using four real credit default datasets show that PLTR predicts credit risk significantly more accurately than logistic regression and compares competitively to the random forest method
Fichier principal
Vignette du fichier
Machine learning for credit scoring.pdf (1.32 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03331114 , version 1 (02-02-2022)

Identifiants

Citer

Elena Ivona Dumitrescu, Sullivan Hué, Christophe Hurlin, Sessi Tokpavi. Machine Learning for Credit Scoring: Improving Logistic Regression with Non Linear Decision Tree Effects. European Journal of Operational Research, 2022, 297 (3), pp.1178-1192. ⟨10.1016/j.ejor.2021.06.053⟩. ⟨hal-03331114⟩
454 Consultations
1072 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More