Talks and Poster Presentations (with Proceedings-Entry):

T. Rausch, W. Hummer, P. Leitner, S. Schulte:
"An Empirical Analysis of Build Failures in the Continuous Integration Workflows of Java-Based Open-Source Software";
Talk: IEEE/ACM 14th International Conference on Mining Software Repositories (MSR 2017), Buenos Aires, Argentina; 2017-05-20 - 2017-05-21; in: "Proceedings of the IEEE/ACM 14th International Conference on Mining Software Repositories (MSR 2017)", IEEE, (2017), ISBN: 978-1-5386-1544-7; 345 - 355.

English abstract:
Continuous Integration (CI) has become a common practice in both industrial and open-source software development. While CI has evidently improved aspects of the software development process, errors during CI builds pose a threat to development efficiency. As an increasing amount of time goes into fixing such errors, failing builds can significantly impair the development process and become very costly. We perform an indepth analysis of build failures in CI environments. Our approach links repository commits to data of corresponding CI builds. Using data from 14 open-source Java projects, we first identify 14 common error categories. Besides test failures, which are by far the most common error category (up to >80% per project), we also identify noisy build data, e.g., induced by transient Git interaction errors, or general infrastructure flakiness. Second, we analyze which factors impact the build results, taking into account general process and specific CI metrics. Our results indicate that process metrics have a significant impact on the build outcome in 8 of the 14 projects on average, but the strongest influencing factor across all projects is overall stability in the recent build history. For 10 projects, more than 50% (up to 80%) of all failed builds follow a previous build failure. Moreover, the fail ratio of the last k=10 builds has a significant impact on build results for all projects in our dataset.

mining software repositories; continuous integration; build errors; correlation analysis

"Official" electronic version of the publication (accessed through its Digital Object Identifier - DOI)

Related Projects:
Project Head Stefan Schulte:
Cloud-based Rapid Elastic MAnufacturing

Created from the Publication Database of the Vienna University of Technology.