Observatorio de I+D+i UPM

Memorias de investigación
Conferencias:
An External Replication on the Effects of Test-driven Development Using a Multi-site Blind Analysis Approach
Año:2016
Áreas de investigación
  • Informática
Datos
Descripción
Artículo publicado en Conferencia Core A. Best Full Paper Award Context: Test-driven development (TDD) is an agile practice claimed to improve the quality of a software product, as well as the productivity of its developers. A previous study (i.e., baseline experiment) at the University of Oulu (Finland) compared TDD to a test-last development (TLD) approach through a randomized controlled trial. The results failed to support the claims. Goal: We want to validate the original study results by replicating it at the University of Basilicata (Italy), using a different design. Method: We replicated the baseline experiment, using a crossover design, with 21 graduate students. We kept the settings and context as close as possible to the baseline experiment. In order to limit researchers bias, we involved two other sites (UPM, Spain, and Brunel, UK) to conduct blind analysis of the data. Results: The Kruskal-Wallis tests did not show any significant difference between TDD and TLD in terms of testing effort (p-value = .27 ), external code quality (p- value = .82 ), and developers' productivity (p-value = .83 ). Nevertheless, our data revealed a difference based on the order in which TDD and TLD were applied, though no carry over effect. Conclusions: We verify the baseline study results, yet our results raises concerns regarding the selection of experimental objects, particularly with respect to their interaction with the order in which of treatments are applied.
Internacional
Si
ISSN o ISBN
978-1-4503-4427-2
Entidad relacionada
ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2016
Nacionalidad Entidad
Sin nacionalidad
Lugar del congreso
Esta actividad pertenece a memorias de investigación
Participantes
  • Autor: Davide Fucci (University of Oulu)
  • Autor: Fernando Uyaguari Uyaguari (UPM)
  • Autor: Natalia Juristo Juzgado (UPM)
Grupos de investigación, Departamentos, Centros e Institutos de I+D+i relacionados
  • Creador: Departamento: Lenguajes y Sistemas Informáticos e Ingeniería de Software
S2i 2021 Observatorio de investigación @ UPM con la colaboración del Consejo Social UPM
Cofinanciación del MINECO en el marco del Programa INNCIDE 2011 (OTR-2011-0236)
Cofinanciación del MINECO en el marco del Programa INNPACTO (IPT-020000-2010-22)