Download bacterio mutation test system user manual

Em pres a d e B as e T ec no l ó gic a
Universidad de Castilla-La Mancha
INDEX OF DE CONTENT
INDEX OF DE CONTENT ......................................................................................................................... 2
INDEX OF TABLES................................................................................................................................... 4
INDEX OF FIGURES ................................................................................................................................. 5
1.
2.
WHAT IS MUTATION TESTING ....................................................................................................... 8
1.2.
INTRODUCTION ........................................................................................................................... 8
1.3.
MUTATION TYPES ...................................................................................................................... 10
1.4.
KILLING MATRIXES..................................................................................................................... 13
AN OVERVIEW OF BACTERIO ..................................................................................................... 15
2.2.
BACTERIO IN A NUTSHELL .......................................................................................................... 15
2.3.
LICENSING ................................................................................................................................ 15
2.4.
THIRD PARTY SOFTWARE. .......................................................................................................... 15
2.4.1.
ASM.................................................................................................................................... 15
2.4.2.
JODE: Java Optimize and Decompile Environment .......................................................... 16
2.4.3.
A DOOM image .................................................................................................................. 17
2.5.
3.
THE TESTING PROCESS WITH BACTERIO: AN OVERVIEW............................................................... 17
2.5.1.
Mutant generation. ............................................................................................................. 18
2.5.2.
Mutant combination for producing mutant versions. .......................................................... 19
2.5.3.
Test case execution. .......................................................................................................... 20
A FIRST EXECUTION ..................................................................................................................... 21
3.1.
INITIAL EXECUTION AND CONFIGURATION .................................................................................... 21
3.2.
CONFIGURATION OF FOLDERS.................................................................................................... 23
3.3.
MUTANT GENERATION STEP ....................................................................................................... 24
3.3.1.
Selecting the elements to mutate ....................................................................................... 25
3.3.2.
Selection of mutation operators ......................................................................................... 26
3.3.3.
Selecting options to generate versions .............................................................................. 28
3.3.4.
Generation of mutant classes and mutant versions ........................................................... 30
3.4.
TEST CASES EXECUTION............................................................................................................ 32
3.5.
RESULT ANALYSIS ..................................................................................................................... 36
3.5.1.
Random test cases ............................................................................................................ 39
3.5.2.
Enriching the test suite with more test cases ..................................................................... 41
3.5.3.
Detection of equivalent versions ........................................................................................ 45
2
Paseo de la Universidad, 4 | 13071 Ciudad Real | Telf.: (+34) 926 295 300 | Fax.: (+34) 926 295 354