An AI-Driven Predictive Framework for Intelligent Test Prioritisation in CI/CD Environments
Keywords:
AI-driven testing, CI/CD pipeline, Statistical Machine Learning, Software testing, Software quality assurance, Test case prioritisationAbstract
Software quality has become essential for ensuring modern applications perform reliably amid increasing complexity and feature richness, where robust testing is critical for security, performance, and user-friendliness. The discussed framework leverages artificial intelligence to predict and prioritize tests within CI/CD pipelines, integrating core engineering principles with advanced testing strategies to streamline processes and elevate overall application quality. Automation tools enhance traditional testing approaches, such as unit testing for individual components, integration testing for interactions, system testing for end-to-end functionality, and user acceptance testing for user alignment, by reducing manual effort. At its core, the model's machine learning component analyzes historical defect data to identify high-risk areas, enabling smarter prioritization that accelerates defect detection during development cycles. To validate the framework, a dedicated web application was developed with curated test scenarios, executed test cases, and comprehensive performance and reliability assessments. The results demonstrated significant time savings in testing efforts, higher defect detection rates, improved maintainability, and seamless compatibility with continuous delivery practices. By embedding AI-driven predictions into the software development lifecycle, organizations can achieve more scalable, high-quality software while sustaining CI/CD efficiency. Although certain implementation details may appear intricate or subject to varied interpretations, this approach ultimately fosters the creation of dependable, resilient systems.
References
T. J. Ostrand and E. J. Weyuker, “The Distribution of Faults in a Large Industrial Software System,” 2002 ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA ’02), Rome, Italy, 2002, pp. 55–64.
N. Nagappan and T. Ball, “Use of Relative Code Churn Measures to Predict System Defect Density,” 27th International Conference on Software Engineering (ICSE ’05), St. Louis, MO, USA, 2005, pp. 284–292.
H. Hemmati, A. Arcuri, and L. Briand, “Achieving Scalable Model-Based Testing Through Test Case Diversity,” ACM Transactions on Software Engineering and Methodology, vol. 22, no. 1, Art. no. 6, pp. 1–42, Feb. 2013.
G. Rothermel, R. H. Untch, C. Chu, and M. J. Harrold, “Prioritizing Test Cases for Regression Testing,” IEEE Transactions on Software Engineering, vol. 27, no. 10, pp. 929–948, Oct. 2001.
S. Yoo and M. Harman, “Regression Testing Minimization, Selection and Prioritization: A Survey,” Software Testing, Verification and Reliability, vol. 22, no. 2, pp. 67–120, Mar. 2012.
T. Menzies, Z. Milton, B. Turhan, B. Cukic, Y. Jiang, and A. Bener, “Defect Prediction from Static Code Features: Current Results, Limitations, New Approaches,” Automated Software Engineering, vol. 17, no. 4, pp. 375–407, Dec. 2010.
C. Catal and B. Diri, “A Systematic Review of Software Fault Prediction Studies,” Expert Systems with Applications, vol. 36, no. 4, pp. 7346–7354, May 2009.
J. Humble and D. Farley, Continuous Delivery: Reliable Software Releases Through Build, Test, and Deployment Automation. Upper Saddle River, NJ, USA: Addison-Wesley, 2010.
A. Bertolino, “Software Testing Research: Achievements, Challenges, Dreams,” in 2007 Future of Software Engineering (FOSE ’07), Minneapolis, MN, USA, 2007, pp. 85–103.
L. Breiman, “Random Forests,” Machine Learning, vol. 45, no. 1, pp. 5–32, Oct. 2001.
S. Lessmann, B. Baesens, C. Mues, and S. Pietsch, “Benchmarking Classification Models for Software Defect Prediction: A Proposed Framework and Novel Findings,” IEEE Transactions on Software Engineering, vol. 34, no. 4, pp. 485–496, Jul. 2008.
[A. E. Hassan, “Predicting Faults Using the Complexity of Code Changes,” 2009 IEEE 31st International Conference on Software Engineering (ICSE ’09), Vancouver, BC, Canada, 2009, pp. 78–88.
V. N. Vapnik, The Nature of Statistical Learning Theory. New York, NY, USA: Springer, 1995.
