Structural Testing
This page curates research papers focused on the application of evolutionary testing for automating structural testing. In this approach, testing is treated as an optimization problem, leveraging evolutionary computation techniques to generate test data that covers the software under test in alignment with typical coverage criteria, including statement or branch coverage.
| Reference | Source |
| Vos, T.; Baars, A.; Lindlar, F.; Windisch, A.; Wilmes, B.; Gross, H.; Kruse, P.; Wegener, J.: Industrial Case Studies for Evaluating Search Based Structural Testing. International Journal of Software Engineering and Knowledge Engineering, vol. 22, no. 08, December 2012, pp. 1123-1149. | International Journal of Software Engineering and Knowledge Engineering |
| McMinn, P.; Harman, M.; Lakhotia,K.; Hassoun, Y.; Wegener, J.: Input Domain Reduction through Irrelevant Variable Removal and its Effect on Local, Global, and Hybrid Search-Based Structural Test Data Generation. IEEE Transactions on Software Engineering, vol. 38, no. 2, March-April 2012, pp. 453-477. | IEEE_TSE |
| Lakhotia, K.; Harman, M. and Gross, H.: AUSTIN: A tool fo Search Based Software Testing for the C Language and its Evaluation on Deployed Automotive Systems. Proceedings of the 2nd International Symposium on Search Based Software Engineering (SSBSE ’10), Benevento, Italy, September 2010, pp. 101-110. | SSBSE 2010 |
| Vos, T.; Baars, A.; Lindlar, F.; Kruse, P.; Windisch, A.; Wegener, J.: Industrial Scaled Automated Structural Testing with the Evolutionary Testing Tool. Proceedings of the 3rd International Conference on Software Testing, Verification and Validation (ICST 2010), Paris, France, April 2010, pp. 175-184. | ICST 2010 |
| Wappler, S.; Wegener, J.; Baresel, A.: Evolutionary Testing of Software with Function-assigned Flags. Journal of Systems and Software, vol. 82, no. 11, November 2009, pp. 1767-1779. | Journal of Sysstems and Software |
| Windisch, A.: Search-based Testing of Complex Simulink Models Containing Stateflow Diagrams. 31st International Conference on Software Engineering – Companion Volume, Vancouver, BC, Canada, 2009, pp. 395-398. | ICSE_2009 |
| Gross, H.; Kruse, P.; Wegener, J.; Vos, T.: Evolutionary white-box software test with the EvoTest Framework, a progress report. Proceedings of the 2nd International Workshop on Search-Based Software Testing (SBST 2009), Denver, CO, USA, April 2009, pp. 111-120. | SBST_2009 |
| Harman, M.; Islam, F.; Xie, T.; Wappler, S.: Automated test data generation for aspect-oriented programs. Proceedings of the 8th ACM International Conference on Aspect-oriented Software Development (AOSD ’09), Charlottesville, VA, USA, March 2009, pp. 185-196. | AOSD_2009 aosd09.pdf (illinois.edu) |
| Windisch, A.: Search-Based Testing of Complex Simulink Models containing Stateflow Diagrams. Proceedings of the 1st International Workshop on Search-Based Software Testing (SBST 2008), Lillehammer, Norway, April 2008, pp. 251-251. | Paper: SBST_2008 Poster: Poster_SBST_2008 |
| Prutkina, M., Windisch, A.: Evolutionary Structural Testing of Software with Pointers. Proceedings of the 1st International Workshop on Search-Based Software Testing (SBST 2008), Lillehammer, Norway, April 2008, pp. 231-231. | SBST_2008 |
| Lammermann, F.; Baresel, A.; Wegener, J.: Evaluating evolutionary testability for structure-oriented testing with software measurements. Applied Soft Computing, vol. 8, no. 2, March 2008, pp. 1018-1028. | Applied Soft Computing |
| Wappler, S.; Schieferdecker, I.: Improving Evolutionary Class Testing in the Presence of Non-Public Methods. Proceedings of the 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE ’07), Atlanta, GA, USA, November 2007, pp. 381-384. | Paper: ASE_2007 Poster: Poster_ASE_2007 |
| Wappler, S.; Baresel, A.; Wegener, J.: Improving Evolutionary Testing in the Presence of Function-Assigned Flags. Proceedings of the Testing: Academic and Industrial Conference Practice and Research Techniques (TAIC PART 2007), Windsor, UK, September 2007, pp. 23-34. | TAIC_PART_2007 |
| Windisch, A; Wappler, S.; Wegener J.: Applying Particle Swarm Optimization to Software Testing. Proceedings of the 9th Annual Conference on Genetic and Evolutionary Computation (GECCO 2007), London, UK, July 2007, pp. 1121-1128. | GECCO_2007 |
| Wappler, S.; Wegener, J.: Evolutionary unit testing of object-oriented software using strongly-typed genetic programming. Proceedings of the 8th Annual Conference on Genetic and Evolutionary Computation (GECCO 2006), Vancouver, BC, Canada, July 2006, pp. 1925-1932. | GECCO_2006 |
| Wappler, S.; Wegener, J.: Evolutionary unit testing of object-oriented software using a hybrid evolutionary algorithm. Proceedings of the IEEE International Conference on Evolutionary Computation (CEC 2006), Vancouver, Canada, July 2006, pp. 851-858. | CEC_2006 |
| McMinn, P.; Holcombe, M.: Evolutionary Testing Using an Extended Chaining Approach. Evolutionary Computation, vol.14, no.1, March 2006, pp. 41-64. | Evolutionary Computation Journal |
| Lammermann, F.; Wegener, J.: Test-Goal-Specific Termination Criteria for Evolutionary White-Box Testing by Means of Software Measures. Proceedings of the 6th Metaheuristics International Conference (MIC 2005), Vienna, Austria, August 2005, | MIC_2005 |
| Wappler, S.; Lammermann, F.: Using Evolutionary Algorithms for the Unit Testing of Object-oriented Software. Proceedings of the 7th Annual Conference on Genetic and Evolutionary Computation (GECCO 2005), Washington D.C., USA, June 2005, pp. 1053-1060. | GECCO_2005 |
| Lammermann, F.; Wappler, S.: Benefits of Software Measures for Evolutionary White-box Testing. Proceedings of the 7th Annual Conference on Genetic and Evolutionary Computation (GECCO 2005), Washington D.C., USA, June 2005, pp. 1083-1084. | GECCO_2005 |
| Harman, M.; Hu, L.; Hierons, R.; Wegener, J.; Sthamer, H.; Baresel, A.; Roper, M.: Testability Transformation. IEEE Transactions on Software Engineering, vol. 30, no. 01, 2004, pp. 3-16. | IEEE_TSE |
| Baresel, A.; Conrad, M.; Sadeghipour, S.; Wegener, J.: The Interplay between Model Coverage and Code Coverage. Proceedings of the 11th European International Conference on Software Testing, Analysis and Review (EuroSTAR 2003), Amsterdam, Netherlands, November 2003. | EUROSTAR_2003 |
| McMinn, P.; Holcombe, M.: The State Problem for Evolutionary Testing. Proceedings of the 5th Annual Conference on Genetic and Evolutionary Computation (GECCO 2003), Chicago, IL, USA, July 2003, pp. 2488-2497. | GECCO_2003 |
| Baresel, A.; Pohlheim, H.; Sadeghipour, S.: Structural and Functional Sequence Test of Dynamic and State-Based Software with Evolutionary Algorithms. Proceedings of the 5th Annual Conference on Genetic and Evolutionary Computation (GECCO 2003), Chicago, IL, USA, July 2003, pp. 2428-2441. | GECCO_2003 |
| Baresel, A.; Sthamer, H.: Evolutionary Testing of Flag Conditions. Proceedings of the 5th Annual Conference on Genetic and Evolutionary Computation (GECCO 2003), Chicago, IL, USA, July 2003, pp. 2442-2454. | GECCO_2003 |
| Sthamer, H.; Wegener, J.; Baresel, A: Using Evolutionary Testing to improve Efficiency and Quality in Software Testing. Proceedings of the Asian Conference on Software Testing, Analysis and Review (AsiaSTAR 2002), Melbourne, Australia, December 2002. | AsiaSTAR_2002 |
| Wegener, J.; Sthamer, H.; Buhr, K.: Connection between Complexity Measures and Evolutionary (Structural) Testability. 2nd International Workshop on Software Engineering using Metaheuristic Innovative Algorithms (SEMINAL 2002), UK, October 2002. | Seminal_2002 |
| Harman, M.; Hu, L.; Hierons, R.; Baresel, A.; Sthamer, H.: Improving Evolutionary Testing by Flag Removal. Proceedings of the 4th Annual Conference on Genetic and Evolutionary Computation (GECCO 2002), New York, NY, USA, July 2002, pp. 1359-1366. | GECCO_2002 |
| Wegener, J.; Buhr, K.; Pohlheim, H.: Automatic Test Data Generation for Structural Testing of Embedded Software Systems by Evolutionary Testing. Proceedings of the 4th Annual Conference on Genetic and Evolutionary Computation (GECCO 2002), New York, NY, USA, July 2002, pp. 1233-1240. | GECCO_2002 |
| Baresel, A.; Sthamer, H.; Schmidt, M.: Fitness Function Design to Improve Evolutionary Structural Testing. Proceedings of the 4th Annual Conference on Genetic and Evolutionary Computation (GECCO 2002), New York, NY, USA, July 2002, pp. . | GECCO_2002 |
| Wegener, J.; Baresel, A.; Sthamer, H.: Evolutionary Test Environment for Automatic Structural Testing. Information and Software Technology, Special Issue devoted to the Application of Metaheuristic Algorithms to Problems in Software Engineering, vol. 43, no. 14, December 2001, Elsevier, pp. 841-854. | Information and Software Technology Journal |
| McGraw, G.; Michael, C.; Schatz, M.: Generating Software Test Data by Evolution. IEEE Transactions on Software Engineering, vol. 27, no. 12, December 2001, pp. 1085-1110. | IEEE TSE |
| Jain, B. J.; Pohlheim, H.; Wegener, J.: On Termination Criteria of Evolutionary Algorithms. Proceedings of the 3rd Annual Conference on Genetic and Evolutionary Computation (GECCO 2001), San Francisco, CA, USA, July 2001, pp. 768-768. | GECCO_2001 |
| Sthamer, H.; Baresel, A.; Wegener, J.: Evolutionary Testing of Embedded Systems. Proceedings of the 14th International Internet & Software Quality Week, San Francisco, CA, USA, May/June 2001. | Paper: QW_2001 Presentation: QW_2001 |
| Wegener, J.: An Overview on Evolutionary Testing at DaimlerChrysler. Keynote of the 4th Seminal-Workshop, Pontypridd, Wales, UK, July 2000. | |
| Pargas, R.; Harrold, M.; Peck, R.: Test Data Generation using Genetic Algorithms. Journal of Software Testing, Verification & Reliability, vol. 9, no. 4, December 1999, pp. 263-282. | Journal of Software Testing, Verification and Reliability |
| Jones, B.; Eyres, D.; Sthamer, H.: A Strategy for using Genetic Algorithms to Automate Branch and Fault-based Testing. Computer Journal, vol. 41, no. 2, January 1998, pp. 98-107. | The Computer Journal |
| Michael, C.; McGraw, G.; Schatz, M.; Walton, C.: Genetic Algorithms for Dynamic Test Data Generation. Proceedings of the 12th International Conference on Automated Software Engineering (ASE ’97), November 1997, pp. 307-307. | ASE_1997 |
| Jones, B.; Sthamer, H.; Eyres, D.: Automatic Structural Testing Using Genetic Algorithms. Software Engineering Journal, vol. 11, no. 5, September 1996, pp. 299-306. | Software Engineering Journal |
Dissertations, Diploma and Master Theses related to Evolutionary Structural Testing
| Reference | Source |
| Windisch, A.: Vergleichende Analyse von Genetischen Algorithmen und der Particle Swarm Optimization für den Evolutionären Strukturtest. Diploma Thesis, Technical University Berlin, Berlin, Germany, April 2007. | Diploma_Thesis |
| Wappler, S.: Evolutionärer Test objektorientierter Systeme. Master’s Thesis, Hasso-Plattner-Institute at University of Potsdam, September 2004. | |
| Baresel, A.: Automatisierung von Strukturtests mit evolutionären Algorithmen. Diploma Thesis, Humboldt-University zu Berlin, Berlin, Germany, July 2000. | Diploma_Thesis |
| Sthamer, H.: The Automatic Generation of Software Test Data Using Genetic Algorithms. PhD Thesis, University of Glamorgan, Pontyprid, Wales, UK, April 1996. | PhD Thesis |