Memorias de investigación
Ponencias en congresos:
The Risk of Using the Q Heterogeneity Estimator for Software Engineering Experiments
Año:2011
Áreas de investigación
  • Ciencias de la computación y tecnología informática
Datos
Descripción
Background: All meta-analyses should include a heterogeneity analysis. Even so, it is not easy to decide whether a set of studies are homogeneous or heterogeneous because of the low statistical power of the statistics used (usually the Q test). Objective: Determine a set of rules enabling SE researchers to find out, based on the characteristics of the experiments to be aggregated, whether or not it is feasible to accurately detect heterogeneity. Method: Evaluate the statistical power of heterogeneity detection methods using a Monte Carlo simulation process. Results: The Q test is not powerful when the meta-analysis contains up to a total of about 200 experimental subjects and the effect size difference is less than 1. Conclusions: The Q test cannot be used as a decision-making criterion for meta-analysis in small sample settings like SE. Random effects models should be used instead of fixed effects models. Caution should be exercised when applying Q test-mediated decomposition into subgroups.
Internacional
No
Nombre congreso
ESEM - International Symposium on Empirical Software Engineering and Measurement
Tipo de participación
960
Lugar del congreso
Banff, Alberta (CANADA)
Revisores
Si
ISBN o ISSN
978-1-4577-2203-5
DOI
Fecha inicio congreso
19/09/2011
Fecha fin congreso
23/09/2011
Desde la página
68
Hasta la página
76
Título de las actas
ESEM 2011 Fifth International Symposium on Empirical Software Engineering and Measurement
Esta actividad pertenece a memorias de investigación
Participantes
  • Autor: Oscar Dieste Tubio UPM
  • Autor: Enrique Fernández Universidad Nacional de La Plata. Buenos Aires, Argentina
  • Autor: Ramón García-Martínez Universidad Nacional de Lanus. Buenos Aires, Argentina
  • Autor: Natalia Juristo Juzgado UPM
Grupos de investigación, Departamentos, Centros e Institutos de I+D+i relacionados
  • Creador: Grupo de Investigación: Ingeniería del Software