Skip to main content
Top

15-03-2023 | Original Research

Predicting inmates misconduct using the SHAP approach

Authors: Fábio M. Oliveira, Marcelo S. Balbino, Luis E. Zarate, Fawn Ngo, Ramakrishna Govindu, Anurag Agarwal, Cristiane N. Nobre

Published in: Artificial Intelligence and Law

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Internal misconduct is a universal problem in prisons and affects the maintenance of social order. Consequently, correctional institutions often develop rehabilitation programs to reduce the likelihood of inmates committing internal offenses and criminal recidivism after release. Therefore, it is necessary to identify the profile of each offender, both for the appropriate indication of a rehabilitation program and the level of internal security to which he must be submitted. In this context, this work aims to discover the most significant characteristics in predicting inmate misconduct from ML methods and the SHAP approach. A database produced in 2004 through the Survey of Inmates in State and Federal Correctional Facilities in the United States of America was used, which provides nationally representative data on prisoners from state and federal facilities. The predictive model based on Random Forest performed the best, thus, we applied the SHAP to it. Overall, the results showed that features related to victimization, type of crime committed, age and age at first arrest, history of association with criminal groups, education, and drug and alcohol use are most relevant in predicting internal misconduct. Thus, it is expected to contribute to the prior classification of an inmate on time, to use programs and practices that aim to improve the lives of offenders, their reintegration into society, and consequently, the reduction of criminal recidivism.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Footnotes
1
While some authors differentiate interpretability and explainability (Gilpin et al. 2018; Rudin 2019), others use them interchangeably (Silva et al. 2018; Carvalho et al. 2019; Molnar 2020). In this work, we use the words interchangeably in the sense of understandability in human terms.
 
2
Agnostic method of explanation is defined as one that is independent of the original model type Carvalho et al. (2019).
 
3
In 2016, the survey was renamed the Survey of Prison Inmates (SPI) (of Justice Statistics 2021).
 
4
We applied the library Missingpy in Python.
 
6
For the Decision Tree, we use the following hyperparameters: criterion=’entropy’, maximum depth = 100. All other parameters are default.
 
7
For the Random Forest, we use the following hyperparameters: criterion=’entropy’, n_estimators = 100. All other parameters are default.
 
8
For the Multilayer Perceptron, we use the following hyperparameters: hidden_layer_sizes=15, learning_rate=0.2, momentum=0.3. All other parameters are default.
 
9
For the Support Vector Machine, we use the following hyperparameters: probability=True, degree=1, gamma=scale, kernel =rbf. All other parameters are default.
 
11
\(\textit{Precision} = \frac{TP}{TP + FP}\)
 
12
\(\textit{Recall} = \frac{TP}{TP + FN}\)
 
13
\(\textit{F1-Score}\) = \(2 \times \frac{Precision\; \times\; Recall}{Precision\; + \;Recall}\)
 
14
Dependence Plot, available in SHAP.
 
15
Force Plot, available in SHAP.
 
Literature
go back to reference Aas K, Jullum M, Løland A (2021) Explaining individual predictions when features are dependent: more accurate approximations to shapley values. Artif Intell 298(103):502MathSciNetMATH Aas K, Jullum M, Løland A (2021) Explaining individual predictions when features are dependent: more accurate approximations to shapley values. Artif Intell 298(103):502MathSciNetMATH
go back to reference Adadi A, Berrada M (2018) Peeking inside the black-box: A survey on explainable artificial intelligence (XAI). IEEE Access 6:52,138-52,160CrossRef Adadi A, Berrada M (2018) Peeking inside the black-box: A survey on explainable artificial intelligence (XAI). IEEE Access 6:52,138-52,160CrossRef
go back to reference Augustyn RA, ten Bensel T, Lytle RD et al (2020) “Older’’ inmates in prison: considering the tipping point of age and misconduct. Criminol Crim Just L & Soc’y 21:1 Augustyn RA, ten Bensel T, Lytle RD et al (2020) “Older’’ inmates in prison: considering the tipping point of age and misconduct. Criminol Crim Just L & Soc’y 21:1
go back to reference Bhuller M, Dahl GB, Løken KV et al (2020) Incarceration, recidivism, and employment. J Polit Econ 128(4):1269–1324CrossRef Bhuller M, Dahl GB, Løken KV et al (2020) Incarceration, recidivism, and employment. J Polit Econ 128(4):1269–1324CrossRef
go back to reference Carvalho DV, Pereira EM, Cardoso JS (2019) Machine learning interpretability: a survey on methods and metrics. Electronics 8(8):832CrossRef Carvalho DV, Pereira EM, Cardoso JS (2019) Machine learning interpretability: a survey on methods and metrics. Electronics 8(8):832CrossRef
go back to reference Daquin JC (2017) Inmate misconduct and victimization: investigating the changes over time and if the risk factors are invariant across age and victim-offender status. Dissertation, Georgia State University, Georgia, United States Daquin JC (2017) Inmate misconduct and victimization: investigating the changes over time and if the risk factors are invariant across age and victim-offender status. Dissertation, Georgia State University, Georgia, United States
go back to reference Denny M (2016) Norway’s prison system: investigating recidivism and reintegration. Bridges J Stud Res 10(10):21–37 Denny M (2016) Norway’s prison system: investigating recidivism and reintegration. Bridges J Stud Res 10(10):21–37
go back to reference ElShawi R, Sherif Y, Al-Mallah M et al (2020) Interpretability in healthcare: a comparative study of local machine learning interpretability techniques. Comput Intell 37(4):1633–1650MathSciNetCrossRef ElShawi R, Sherif Y, Al-Mallah M et al (2020) Interpretability in healthcare: a comparative study of local machine learning interpretability techniques. Comput Intell 37(4):1633–1650MathSciNetCrossRef
go back to reference Heskes T, Sijben E, Bucur IG et al (2020) Causal shapley values: exploiting causal knowledge to explain individual predictions of complex models. Adv Neural Inf Process Syst 33:4778–4789 Heskes T, Sijben E, Bucur IG et al (2020) Causal shapley values: exploiting causal knowledge to explain individual predictions of complex models. Adv Neural Inf Process Syst 33:4778–4789
go back to reference Kantardzic M (2002) Data mining: concepts, models. Methods and algorithms. John Wiley & Sons Inc, New YorkMATH Kantardzic M (2002) Data mining: concepts, models. Methods and algorithms. John Wiley & Sons Inc, New YorkMATH
go back to reference Karim A, Mishra A, Newton M, et al (2018) Machine learning interpretability: a science rather than a tool. arXiv preprint arXiv:1807.06722 Karim A, Mishra A, Newton M, et al (2018) Machine learning interpretability: a science rather than a tool. arXiv preprint arXiv:​1807.​06722
go back to reference Langan PA, Levin DJ (2002) Recidivism of prisoners released in 1994. Federal Sentenc Rep 15(1):58–65CrossRef Langan PA, Levin DJ (2002) Recidivism of prisoners released in 1994. Federal Sentenc Rep 15(1):58–65CrossRef
go back to reference Lundberg SM, Lee SI (2017) A unified approach to interpreting model predictions. In: Proceedings of the 31st international conference on neural information processing systems, pp 4768–4777 Lundberg SM, Lee SI (2017) A unified approach to interpreting model predictions. In: Proceedings of the 31st international conference on neural information processing systems, pp 4768–4777
go back to reference Mohanty SD, Lekan D, McCoy TP et al (2021) Machine learning for predicting readmission risk among the frail: explainable AI for healthcare. Patterns (N Y) 3(1):100–395 Mohanty SD, Lekan D, McCoy TP et al (2021) Machine learning for predicting readmission risk among the frail: explainable AI for healthcare. Patterns (N Y) 3(1):100–395
go back to reference Mokhtari KE, Higdon BP, Başar A (2019) Interpreting financial time series with shap values. In: Proceedings of the 29th annual international conference on computer science and software engineering, pp 166–172 Mokhtari KE, Higdon BP, Başar A (2019) Interpreting financial time series with shap values. In: Proceedings of the 29th annual international conference on computer science and software engineering, pp 166–172
go back to reference Montavon G, Lapuschkin S, Binder A et al (2017) Explaining nonlinear classification decisions with deep taylor decomposition. Pattern Recogn 65:211–222CrossRef Montavon G, Lapuschkin S, Binder A et al (2017) Explaining nonlinear classification decisions with deep taylor decomposition. Pattern Recogn 65:211–222CrossRef
go back to reference Na C, Oh G, Song J et al (2021) Do machine learning methods outperform traditional statistical models in crime prediction? A comparison between logistic regression and neural networks. Kor J Policy Stud 36(1):1–13CrossRef Na C, Oh G, Song J et al (2021) Do machine learning methods outperform traditional statistical models in crime prediction? A comparison between logistic regression and neural networks. Kor J Policy Stud 36(1):1–13CrossRef
go back to reference Ngo FT, Govindu R, Agarwal A (2015) Assessing the predictive utility of logistic regression, classification and regression tree, chi-squared automatic interaction detection, and neural network models in predicting inmate misconduct. Am J Crim Justice 40(1):47–74CrossRef Ngo FT, Govindu R, Agarwal A (2015) Assessing the predictive utility of logistic regression, classification and regression tree, chi-squared automatic interaction detection, and neural network models in predicting inmate misconduct. Am J Crim Justice 40(1):47–74CrossRef
go back to reference Ooi EJ (2019) Evaluating the impact of the intensive drug and alcohol treatment program (idatp) on prisoner misconduct. BOCSAR NSW Crime and Justice Bulletins, p 12 Ooi EJ (2019) Evaluating the impact of the intensive drug and alcohol treatment program (idatp) on prisoner misconduct. BOCSAR NSW Crime and Justice Bulletins, p 12
go back to reference Ozkan T (2017) Predicting recidivism through machine learning. Doctor of philosophy in criminology, The University of Texas at Dallas Ozkan T (2017) Predicting recidivism through machine learning. Doctor of philosophy in criminology, The University of Texas at Dallas
go back to reference Pryzant R, Shen K, Jurafsky D, et al (2018) Deconfounded lexicon induction for interpretable social science. In: Proceedings of the 2018 conference of the North American chapter of the association for computational linguistics: human language technologies, Volume 1 (Long Papers). Association for computational linguistics, New Orleans, Louisiana, pp 1615–1625, https://doi.org/10.18653/v1/N18-1146 Pryzant R, Shen K, Jurafsky D, et al (2018) Deconfounded lexicon induction for interpretable social science. In: Proceedings of the 2018 conference of the North American chapter of the association for computational linguistics: human language technologies, Volume 1 (Long Papers). Association for computational linguistics, New Orleans, Louisiana, pp 1615–1625, https://​doi.​org/​10.​18653/​v1/​N18-1146
go back to reference Qayyum S, Hafsa S, Dar H (2018) Survey of data mining techniques for crime detection. Univ Sindh J Inf Commun Technol (USJICT) 2(1):1–6 Qayyum S, Hafsa S, Dar H (2018) Survey of data mining techniques for crime detection. Univ Sindh J Inf Commun Technol (USJICT) 2(1):1–6
go back to reference Rembert DA, Henderson H, Threadcraft-Walker W et al (2018) Predicting staff assault in juvenile correctional facilities. Corrections 3(3):170–185CrossRef Rembert DA, Henderson H, Threadcraft-Walker W et al (2018) Predicting staff assault in juvenile correctional facilities. Corrections 3(3):170–185CrossRef
go back to reference Rudin C (2018) Please stop explaining black box models for high stakes decisions. Proc 32nd Conf Neural Inf Process Syst (NIPS), Workshop Critiquing Correcting Trends Mach Learn pp 1–20. arXiv:1811.10154 Rudin C (2018) Please stop explaining black box models for high stakes decisions. Proc 32nd Conf Neural Inf Process Syst (NIPS), Workshop Critiquing Correcting Trends Mach Learn pp 1–20. arXiv:​1811.​10154
go back to reference Severson RE (2020) Mental health and in-prison experiences: examining socioeconomic and sex differences in the effect of mental illness on institutional misconduct and disciplinary segregation. University of South Florida, Doutorado Severson RE (2020) Mental health and in-prison experiences: examining socioeconomic and sex differences in the effect of mental illness on institutional misconduct and disciplinary segregation. University of South Florida, Doutorado
go back to reference Silva W, Fernandes K, Cardoso MJ, et al (2018) Towards complementary explanations using deep neural networks. In: Understanding and interpreting machine learning in medical image computing applications. Springer, pp 133–140 Silva W, Fernandes K, Cardoso MJ, et al (2018) Towards complementary explanations using deep neural networks. In: Understanding and interpreting machine learning in medical image computing applications. Springer, pp 133–140
go back to reference Steiner B (2018) Measuring and explaining inmate misconduct. The Oxford handbook of prisons and imprisonment p 235 Steiner B (2018) Measuring and explaining inmate misconduct. The Oxford handbook of prisons and imprisonment p 235
go back to reference Stekhoven DJ (2013) missForest: nonparametric missing value imputation using random forest. R Package Version 1.4 Stekhoven DJ (2013) missForest: nonparametric missing value imputation using random forest. R Package Version 1.4
go back to reference Teasdale B, Daigle LE, Hawk SR et al (2016) Violent victimization in the prison context: an examination of the gendered contexts of prison. Int J Offender Ther Comp Criminol 60(9):995–1015CrossRef Teasdale B, Daigle LE, Hawk SR et al (2016) Violent victimization in the prison context: an examination of the gendered contexts of prison. Int J Offender Ther Comp Criminol 60(9):995–1015CrossRef
go back to reference Thomas M (2020) An exploration of recidivism based on education and race. PhD thesis, Public Policy and Administration, Walden University, Minnesota Thomas M (2020) An exploration of recidivism based on education and race. PhD thesis, Public Policy and Administration, Walden University, Minnesota
go back to reference Zajacova A, Everett BG (2014) The nonequivalent health of high school equivalents. Soc Sci Q 95(1):221–238CrossRef Zajacova A, Everett BG (2014) The nonequivalent health of high school equivalents. Soc Sci Q 95(1):221–238CrossRef
Metadata
Title
Predicting inmates misconduct using the SHAP approach
Authors
Fábio M. Oliveira
Marcelo S. Balbino
Luis E. Zarate
Fawn Ngo
Ramakrishna Govindu
Anurag Agarwal
Cristiane N. Nobre
Publication date
15-03-2023
Publisher
Springer Netherlands
Published in
Artificial Intelligence and Law
Print ISSN: 0924-8463
Electronic ISSN: 1572-8382
DOI
https://doi.org/10.1007/s10506-023-09352-z

Premium Partner