Explainable AI in Legal Text Analysis: A Comprehensive Review of Legal Threat Assessment Approaches
Keywords:
Explainable artificial intelligence, Legal document analysis, Legal risk assessment, Machine learning, Natural language processing, Threat level predictionAbstract
The volume of legal documents continues to expand rapidly, and their language is becoming increasingly intricate, making manual review both time-intensive and vulnerable to individual bias and inconsistency. As a result, recent research has increasingly focused on the use of machine learning techniques to predict threat levels and evaluate legal risks directly from textual data. Although such models have demonstrated promising predictive performance, a major limitation remains the lack of transparency in their decision-making processes. In legal practice, where accountability and justification are essential, predictions without clear explanations are difficult to accept and apply. This review examines studies published between 2018 and 2025 addressing automated legal document analysis, with particular emphasis on methods that combine accurate threat prediction with explainability. The reviewed works cover a broad range of approaches, including natural language processing, deep learning, transformer-based architectures, graph-based models, large language models, and contract analysis techniques. Explainable artificial intelligence methods such as LIME, SHAP, and attention-based visualization are examined for their role in making model predictions transparent and legally meaningful. Recurring design patterns observed across the reviewed systems are synthesized into a conceptual framework of six sequential stages covering input, text processing, feature encoding, threat classification, explainability, and output. The analysis identifies dataset scarcity, inconsistent evaluation practices, and limited generalization across legal domains as the primary barriers to practical deployment. The review concludes that explainability is a foundational requirement rather than an optional feature for any AI system intended to support legal decision-making.
References
S. Li, H. Zhang, L. Ye, X. Guo, and B. Fang, “MANN: A multichannel attentive neural network for legal judgment prediction,” IEEE Access, vol. 7, pp. 151144–151155, 2019.
S. Tong, J. Yuan, P. Zhang, and L. Li, “Legal judgment prediction via graph boosting with constraints,” Inf. Process. Manag., vol. 61, no. 3, p. 103663, 2024.
Q. Zhao, T. Gao, and N. Guo, “LA-MGFM: A legal judgment prediction method via sememe-enhanced graph neural networks and multi-graph fusion mechanism,” Inf. Process. Manag., vol. 60, no. 5, 2023.
Y. Zhang, X. Wei, and H. Yu, “HD-LJP: A hierarchical dependency-based legal judgment prediction framework for multi-task learning,” Knowl.-Based Syst., vol. 299, 2024.
Y. Lyu et al., “Improving legal judgment prediction through reinforced criminal element extraction,” Inf. Process. Manag., vol. 59, no. 1, 2022.
Q. Zhao, “Legal judgment prediction via legal knowledge extraction and fusion,” J. King Saud Univ. Comput. Inf. Sci., vol. 37, p. 31, 2025.
K. Atkinson, T. Bench-Capon, and D. Bollegala, “Explanation in AI and law: Past, present and future,” Artificial Intelligence, vol. 289, 2020.
J. Collenette, K. Atkinson, and T. Bench-Capon, “Explainable AI tools for legal reasoning about cases: A study on the European Court of Human Rights,” Artificial Intelligence, vol. 317, 2023.
C. He, T.-P. Tan, S. Xue, and Y. Tan, “Explaining legal judgments: A multitask learning framework for enhancing factual consistency in rationale generation,” J. King Saud Univ. Comput. Inf. Sci., vol. 35, no. 10, 2023.
F. de Arriba-Pérez et al., “Explainable machine learning multi-label classification of Spanish legal judgements,” J. King Saud Univ. Comput. Inf. Sci., vol. 34, no. 10, pt. B, 2022.
M. K. Nallakaruppan et al., “An explainable AI framework for credit evaluation and analysis,” Appl. Soft Comput., vol. 153, 2024.
O. Arreche et al., “E-XAI: Evaluating black-box explainable AI frameworks for network intrusion detection,” IEEE Access, vol. 12, pp. 23954–23988, 2024.
X. Wang et al., “LegalReasoner: A multi-stage framework for legal judgment prediction via large language models and knowledge integration,” IEEE Access, vol. 12, pp. 166843–166854, 2024.
W. Han et al., “LegalAsst: Human-centred and AI-empowered machine to enhance court productivity and legal assistance,” Inf. Sci., vol. 679, 2024.
A. Fan, S. Wang, and Y. Wang, “Legal document similarity matching based on ensemble learning,” IEEE Access, vol. 12, pp. 33910–33922, 2024.
R. S. M. Wahidur et al., “Legal query RAG,” IEEE Access, vol. 13, pp. 36978–36994, 2025.
I. Dikmen, G. Eken, H. Erol, and M. T. Birgonul, “Automated construction contract analysis for risk and responsibility assessment using natural language processing and machine learning,” Comput. Ind., vol. 166, 2025.
T. Turan and E. U. Küçüksılle, “Summarization, prediction, and analysis of Turkish constitutional court decisions with explainable artificial intelligence and a hybrid natural language processing method,” IEEE Access, vol. 13, pp. 59766–59779, 2025.
J. Cui, X. Shen, and S. Wen, “A survey on legal judgment prediction: Datasets, metrics, models and challenges,” IEEE Access, vol. 11, pp. 102050–102071, 2023.
A. Adadi and M. Berrada, “Peeking inside the black-box: A survey on explainable artificial intelligence (XAI),” IEEE Access, vol. 6, pp. 52138–52160, 2018.
A. E. Muhammad, K. C. Yow, and N. Bačanin-Džakula, “L-XAIDS: A LIME-based explainable AI framework for intrusion detection systems,” Cluster Comput., vol. 28, p. 654, 2025.