Memorias de investigación
Research Publications in journals:
The role of replications in Empirical Software Engineering
Year:2008

Research Areas
  • Artificial intelligence,
  • Programming language

Information
Abstract
Replications play a key role in Empirical Software Engineering by allowing the community to build knowledge about which results or observations hold under which conditions. Therefore, not only can a replication that produces similar results as the original experiment be viewed as successful, but a replication that produce results different from those of the original experiment can also be viewed as successful. In this paper we identify two types of replications: exact replications, in which the procedures of an experiment are followed as closely as possible; and conceptual replications, in which the same research question is evaluated by using a different experimental procedure. The focus of this paper is on exact replications. We further explore them to identify two sub-categories: dependent replications, where researchers attempt to keep all the conditions of the experiment the same or very similar and independent replications, where researchers deliberately vary one or more major aspects of the conditions of the experiment. We then discuss the role played by each type of replication in terms of its goals, benefits, and limitations. Finally, we highlight the importance of producing adequate documentation for an experiment (original or replication) to allow for replication. A properly documented replication provides the details necessary to gain a sufficient understanding of the study being replicated without requiring the replicator to slavishly follow the given procedures.
International
Si
JCR
Si
Title
EMPIRICAL SOFTWARE ENGINEERING
ISBN
1382-3256
Impact factor JCR
0,795
Impact info
Volume
13
10.1007/s10664-008-9060-1
Journal number
2
From page
211
To page
218
Month
ABRIL
Ranking
Participants
  • Autor: Jeffrey C. Carver Mississippi State University
  • Autor: Sira Vegas Hernandez UPM
  • Autor: Forrst J. Shull Fraunhofer Center for Experimental Software Engineering at College Park
  • Autor: Natalia Juristo Juzgado UPM

Research Group, Departaments and Institutes related
  • Creador: Grupo de Investigación: Ingeniería del Software
  • Departamento: Lenguajes y Sistemas Informáticos e Ingeniería de Software