Memorias de investigación
Artículos en revistas:
Effectiveness for Detecting Faults Within and Outside the Scope of Testing Techniques: an Independent Replication
Año:2014

Áreas de investigación
  • Ciencias de la computación y tecnología informática

Datos
Descripción
The verification and validation activity plays a fundamental role in improving software quality. Determining which the most effective techniques for carrying out this activity are has been an aspiration of experimental software engineering researchers for years. This paper reports a controlled experiment evaluating the effectiveness of two unit testing techniques (the functional testing technique known as equivalence partitioning (EP) and the control-flow structural testing technique known as branch testing (BT)). This experiment is a literal replication of Juristo et al. (2013). Both experiments serve the purpose of determining whether the effectiveness of BT and EP varies depending on whether or not the faults are visible for the technique (InScope or OutScope, respectively). We have used the materials, design and procedures of the original experiment, but in order to adapt the experiment to the context we have: (1) reduced the number of studied techniques from 3 to 2; (2) assigned subjects to experimental groups by means of stratified randomization to balance the influence of programming experience; (3) localized the experimental materials and (4) adapted the training duration. We ran the replication at the Escuela Politécnica del Ejército Sede Latacunga (ESPEL) as part of a software verification & validation course. The experimental subjects were 23 master's degree students. EP is more effective than BT at detecting InScope faults. The session/program and group variables are found to have significant effects. BT is more effective than EP at detecting OutScope faults. The session/program and group variables have no effect in this case. The results of the replication and the original experiment are similar with respect to testing techniques. There are some inconsistencies with respect to the group factor. They can be explained by small sample effects. The results for the session/program factor are inconsistent for InScope faults. We believe that these differences are due to a combination of the fatigue effect and a technique x program interaction. Although we were able to reproduce the main effects, the changes to the design of the original experiment make it impossible to identify the causes of the discrepancies for sure. We believe that further replications closely resembling the original experiment should be conducted to improve our understanding of the phenomena under study.
Internacional
Si
JCR del ISI
Si
Título de la revista
Empirical Software Engineering
ISSN
1382-3256
Factor de impacto JCR
1,64
Información de impacto
Volumen
19
DOI
10.1007/s10664-013-9267-7
Número de revista
2
Desde la página
378
Hasta la página
417
Mes
ABRIL
Ranking

Esta actividad pertenece a memorias de investigación

Participantes
  • Autor: Cecilia Apa Universidad de la República
  • Autor: Oscar Dieste Tubio UPM
  • Autor: Edison Gonzalo Espinosa Gallardo UPM
  • Autor: Efraín Rodrigo Fonseca Carrera UPM

Grupos de investigación, Departamentos, Centros e Institutos de I+D+i relacionados
  • Creador: Grupo de Investigación: Ingeniería del Software
  • Departamento: Lenguajes y Sistemas Informáticos e Ingeniería de Software