[Back]

S. Biffl, M. Kalinowski, F. Ekaputra, A. Neto, T. Conte, D. Winkler:
"Towards a Semantic Knowledge Base on Threats to Validity and Control Actions in Controlled Experiments";
Talk: 8th International Symposium on Empirical Software Engineering and Measurement (ESEM 2014), Torino, Italien; 2014-09-18 - 2014-09-19; in: "Proceedings of the 8th International Symposium on Empirical Software Engineering and Measurement (ESEM)", ACM, (2014), ISBN: 978-1-4503-2774-9.

[Context] Experiment planners need to be aware of relevant Threats to Validity (TTVs), so they can devise effective control actions or accept the risk. [Objective] The aim of this paper is to introduce a TTV knowledge base (KB) that supports experiment planners in identifying relevant TTVs in their research context and actions to control these TTVs. [Method] We identified requirements, designed and populated a TTV KB with data extracted during a systematic review: 63 TTVs and 149 control actions from 206 peer-reviewed published software engineering experiments. We conducted an initial proof of concept on the feasibility of using the TTV KB and analyzed its content. [Results] The proof of concept and content analysis provided indications that experiment planners can benefit from an extensible TTV KB for identifying relevant TTVs and control actions in their specific context. [Conclusions] The TTV KB should be further evaluated and evolved in a variety of software engineering contexts.

Threats to Validity, Controlled Experiment, Systematic Review, Knowledge Engineering, Body of Knowledge

http://dx.doi.org/10.1145/2652524.2652568