The mortgage sector plays a pivotal role in the financial services industry, and the U.S. economy in general, with the Federal Reserve, St. Louis, reporting Households and Nonprofit Organizations for One-to-Four-Family Residential Mortgages Liability Level at $10.8T in Q3 2020. It has been in the interest of banks to know which factors are the most influential predicting mortgage default, and the implementation of survival models can utilize data from defaulted obligors as well as non-default obligors who are still making payments as of the sampling period cutoff date. Besides the Cox proportional hazard model and the accelerated failure time model, this paper investigates two machine learning-based models, a random survival forest model, and a Cox proportional hazard neural network model DeepSurv. We compare the accuracy of covariate selection for the Cox model, AFT model, random survival forest model, and DeepSurv model, and this investigation is the first research using machine learning based survival models for mortgage default prediction. The result shows that Random survival forest can achieve the most accurate, and stable, covariate selection, while DeepSurv can achieve the highest accuracy of default prediction, and finally, the covariates selected by the models can be meaningful for mortgage programs throughout the banking industry.
KeywordsSurvival AnalysisMortgage DefaultCox ModelRandom Survival ForestAccelerated Failure Time ModelDeepSurv
National Association of Realtors (n.d.) Existing Home Sales [EXHOSLUSM495S]. Federal Reserve Economic Data, Federal Reserve Bank of St. Louis, St. Louis. https://fred.stlouisfed.org/series/EXHOSLUSM495S
Kiefer, N.M. (1988) Economic Duration Data and Hazard Functions. Journal of Economic Literature, 26, 646-679.
Allison, P.D. (1982) Discrete-Time Methods for the Analysis of Event Histories. Sociological Methodology, 13, 61-98. https://doi.org/10.2307/270718
Wong, J., Fung, L., Fong, T. and Sze, A. (2004) Residential Mortgage Default Risk and the Loan-to-Value Ratio. Hong Kong Monetary Authority Quarterly Bulletin, 4, 35-45. https://doi.org/10.2139/ssrn.1331270
Ciochetti, B.A, Deng, Y., Lee, G., Shilling, J.D. and Yao, R. (2003) A Proportional Hazards Model of Commercial Mortgage Default with Originator Bias. The Journal of Real Estate Finance and Economics, 27, 5-23. https://doi.org/10.1023/A:1023694912018
Fitzpatrick, T. and Mues, C. (2016) An Empirical Comparison of Classification Algorithms for Mortgage Default Prediction: Evidence from a Distressed Mortgage Market. European Journal of Operational Research, 249, 427-439. https://doi.org/10.1016/j.ejor.2015.09.014
Bajari, P., Chu, C.S. and Park, M. (2008) An Empirical Model of Subprime Mortgage Default from 2000 to 2007. Technical Report, National Bureau of Economic Research, Cambridge. https://doi.org/10.3386/w14625
Zhu, J., Janowiak, J., Ji, L., Karamon, K. and McManus, D. (2015) The Effect of Mortgage Payment Reduction on Default: Evidence from the Home Affordable Refinance Program. Real Estate Economics, 43, 1035-1054. https://doi.org/10.1111/1540-6229.12104
Deng, Y., Quigley, J.M., Van Order, R. and Freddie, M. (1996) Mortgage Default and Low Downpayment Loans: the Costs of Public Subsidy. Regional Science and urban Economic, 26, 267-288. https://doi.org/10.1016/0166-0462(95)02116-7
Moore, D.F. (2016) Applied Survival Analysis Using R. Springer, Cham, 3. https://doi.org/10.1007/978-3-319-31245-3
Harrell, F.E., Califf, R.M., Pryor, D.B., Lee, K.L. and Rosati, R.A. (1982) Evaluating the Yield of Medical Tests. JAMA, 247, 2543-2546. https://doi.org/10.1001/jama.1982.03320430047030
Heagerty, P.J. and Zheng, Y. (2005) Survival Model Predictive Accuracy and Roc curves. Biometrics, 61, 92-105. https://doi.org/10.1111/j.0006-341X.2005.030814.x
Baesens, B., Roesch, D. and Scheule, H. (2016) Credit Risk Analytics: Measurement Techniques, Applications, and Examples in SAS. John Wiley & Sons, Hoboken. http://www.creditriskanalytics.net/
Cox, D.R. (1972) Regression Models and Life-Tables. Journal of the Royal Statistical Society: Series B (Methodological), 34, 187-220. https://doi.org/10.1111/j.2517-6161.1972.tb00899.x
Tibshirani, R. (1996) Regression Shrinkage and Selection via the Lasso. Journal of the Royal Statistical Society: Series B (Methodological), 58, 267-288. https://doi.org/10.1111/j.2517-6161.1996.tb02080.x
Hastie, T., Tibshirani, R. and Tibshirani, R.J. (2017) Extended Comparisons of Best Subset Selection, Forward Stepwise Selection, and the Lasso. https://arxiv.org/abs/1707.08692
Park, M.Y. and Hastie, T. (2007) L1-Regularization Path Algorithm for Generalized Linear Models. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 69, 659-677. https://doi.org/10.1111/j.1467-9868.2007.00607.x
Tibshirani, R. (1997) The Lasso Method for Variable Selection in the Cox Model. Statistics in Medicine, 16, 385-395. https://doi.org/10.1002/(SICI)1097-0258(19970228)16:4%3C385::AID-SIM380%3E3.0.CO;2-3
Liu, E. (2018) Using Weibull Accelerated Failure Time Regression Model to Predict Survival Time and Life Expectancy. https://doi.org/10.1101/362186 https://www.biorxiv.org/content/10.1101/362186v2.full.pdf
Breiman, L. (2001) Random Forests. Machine Learning, 45, 5-32. https://doi.org/10.1023/A:1010933404324
Nasejje, J.B., Mwambi, H., Dheda, K. and Lesosky, M. (2017) A Comparison of the Conditional Inference Survival Forest Model to Random Survival Forests Based on a Simulation Study as Well as on Two Applications with Time-to-Event Data. BMC Medical Research Methodology, 17, Article No. 115. https://doi.org/10.1186/s12874-017-0383-8
Ishwaran, H., Kogalur, U.B., Chen, X. and Minn, A.J. (2011) Random Survival Forests for High-Dimensional Data. Statistical Analysis and Data Mining: The ASA Data Science Journal, 4, 115-132. https://doi.org/10.1002/sam.10103
Ishwaran, H., Kogalur, U.B., Blackstone, E.H. and Lauer, M.S. (2008) Random Survival Forests. The Annals of Applied Statistics, 2, 841-860. https://doi.org/10.1214/08-AOAS169
Katzman, J.L., Shaham, U., Cloninger, A., Bates, J., Jiang, T. and Kluger, Y. (2018) Deepsurv: Personalized Treatment Recommender System Using a Cox Proportional Hazards Deep Neural Network. BMC Medical Research Methodology, 18, Article No. 24. https://doi.org/10.1186/s12874-018-0482-1
https://github.com/havakv/pycox
Kim, D.W., Lee, S., Kwon, S., Nam, W., Cha, I.-H. and Kim, H.J. (2019) Deep Learning-Based Survival Prediction of Oral Cancer Patients. Scientific Reports, 9, Article No. 6994. https://doi.org/10.1038/s41598-019-43372-7
Zhu, X., Yao, J. and Huang, J. (2016) Deep Convolutional Neural Network for Survival Analysis with Pathological Images. 2016 IEEE International Conference on Bioinformatics and Biomedicine, Shenzhen, 15-18 December 2016, 544-547. https://doi.org/10.1109/BIBM.2016.7822579