Test Code Review in the Era of GitHub Actions: A Replication Study
Published in Under Double-Blind Review, 2025
We are the first to analyze GitHub Actions’ influence on test code review, leveraging 213,511 pull requests and 600,905 review comments from six large-scale GitHub projects. We show platform-level differences between GitHub and Gerrit reviews, and find that adoption of GitHub Actions significantly reduced reviewer and developer attention to test code — lower review probability, comment density, and test code churn — highlighting risks of over-reliance on automation. We release a public replication package to ensure transparency and reuse.
