Appendix D — Bibliography

Abad, Zahra Shakeri Hossein, Oliver Karras, Kurt Schneider, Ken Barker, and Mike Bauer. 2018. Task Interruption in Software Development Projects: What Makes Some Interruptions More Disruptive Than Others? Vol. 05508. https://doi.org/10.48550/arXiv.1805.05508.

Anda, B. C. D., D. I. K. Sjoberg, and A. Mockus. 2009. “Variability and Reproducibility in Software Engineering: A Study of Four Companies That Developed the Same System.” IEEE Trans. Software Engineering 35 (3). https://doi.org/10.1109/tse.2008.89.

Aniche, Mauricio, Christoph Treude, and Andy Zaidman. 2021. “How Developers Engineer Test Cases: An Observational Study.” IEEE Trans. Software Engineering, ahead of print. https://doi.org/10.1109/tse.2021.3129889.

Aquino Junior, Gibeon Soares de, and Silvio Romero de Lemos Meira. 2009. “Towards Effective Productivity Measurement in Software Projects.” Proc. SEA’09. https://doi.org/10.1109/icsea.2009.44.

Aranda, Jorge, and Gina Venolia. 2009. “The Secret Life of Bugs: Going Past the Errors and Omissions in Software Repositories.” Proc. ICSE’09. https://doi.org/10.1109/icse.2009.5070530.

Baltes, Sebastian, Florian Angermeir, Chetan Arora, et al. 2025. Evaluation Guidelines for Empirical Studies in Software Engineering Involving LLMs. Vol. 15503. https://doi.org/10.48550/arXiv.2508.15503.

Bano, Muneera, Hashini Gunatilake, and Rashina Hoda. 2025. What Does a Software Engineer Look Like? Exploring Societal Stereotypes in LLMs. Vol. 03569. https://doi.org/10.48550/arXiv.2501.03569.

Basili, V. R., and R. W. Selby. 1987. “Comparing the Effectiveness of Software Testing Strategies.” IEEE Trans. Software Engineering 13 (12). https://doi.org/10.1109/tse.1987.232881.

Basili, Victor R., Gianluigi Caldiera, and H. Dieter Rombach. 1994. “The Goal Question Metric Approach.” Encyclopedia of Software Engineering.

Bauer, Jennifer, Janet Siegmund, Norman Peitek, Johannes C. Hofmeister, and Sven Apel. 2019. “Indentation: Simply a Matter of Style or Support for Program Comprehension?.” Proc. ICPC’19. https://doi.org/10.1109/icpc.2019.00033.

Beck, Kent. 2023. Measuring Developer Productivity: Real-World Examples. https://tidyfirst.substack.com/p/measuring-developer-productivity.

Begel, Andrew, and Nachiappan Nagappan. 2014. “Analyze This! 145 Questions for Data Scientists in Software Engineering.” Proc. ICSE’14. https://doi.org/10.1145/2568225.2568233.

Behroozi, Mahnaz, Shivani Shirolkar, Titus Barik, and Chris Parnin. 2020. “Does Stress Impact Technical Interview Performance?” Proc. ESEC/FSE’20 492: 2020. https://doi.org/10.1145/3368089.3409712.

Beller, Moritz, Georgios Gousios, Annibale Panichella, Sebastian Proksch, Sven Amann, and Andy Zaidman. 2019. “Developer Testing in the IDE: Patterns, Beliefs, and Behavior.” IEEE Trans. Software Engineering 45 (3). https://doi.org/10.1109/tse.2017.2776152.

Beller, Moritz, Georgios Gousios, Annibale Panichella, and Andy Zaidman. 2015. “When, How, and Why Developers (Do Not) Test in Their IDEs.” Proc. FSE’15. https://doi.org/10.1145/2786805.2786843.

Beller, Moritz, Niels Spruit, Diomidis Spinellis, and Andy Zaidman. 2018. “On the Dichotomy of Debugging Behavior Among Programmers.” Proc. ICSE’18. https://doi.org/10.1145/3180155.3180175.

Bettenburg, Nicolas, Sascha Just, Adrian Schröter, Cathrin Weiss, Rahul Premraj, and Thomas Zimmermann. 2008. “What Makes a Good Bug Report?” Proc. SIGSOFT/FSE’08. https://doi.org/10.1145/1453101.1453146.

Bird, Christian, Nachiappan Nagappan, Brendan Murphy, Harald Gall, and Premkumar Devanbu. 2011. “Don’t Touch My Code! Examining the Effects of Ownership on Software Quality.” Proc. SIGSOFT/FSE’11. https://doi.org/10.1145/2025113.2025119.

Bogart, Christopher, Christian Kästner, James Herbsleb, and Ferdian Thung. 2016. “How to Break an API: Cost Negotiation and Community Values in Three Software Ecosystems.” Proc. FSE’16. https://doi.org/10.1145/2950290.2950325.

Bouzenia, Islem, and Michael Pradel. 2025. “Understanding Software Engineering Agents: A Study of Thought-Action-Result Trajectories.” Proc. ASE’25. https://doi.org/10.1109/ASE63991.2025.002344.

Brandt, Joel, Philip J. Guo, Joel Lewenstein, Mira Dontcheva, and Scott R. Klemmer. 2009. “Two Studies of Opportunistic Programming: Interleaving Web Foraging, Learning, and Writing Code.” Proc. CHI’09. https://doi.org/10.1145/1518701.1518944.

Braun, Virginia, and Victoria Clarke. 2019. “Reflecting on Reflexive Thematic Analysis.” Qualitative Research in Sport, Exercise and Health 11 (4). https://doi.org/10.1080/2159676X.2019.1628806.

Brown, Eva Maxfield, Cailean Osborne, Peter Cihon, et al. 2024. Measuring Software Innovation with Open Source Software Development Data. Vol. 05087. https://doi.org/10.48550/arXiv.2411.05087.

Butler, Jenna, Thomas Zimmermann, and Christian Bird. 2023. Objectives and Key Results in Software Teams: Challenges, Opportunities and Impact on Development. Vol. 00236. https://doi.org/10.48550/arXiv.2311.00236.

Campbell, Donald T., and Julian C. Stanley. 1963. Experimental and Quasi-Experimental Designs for Research. Houghton Mifflin.

Cosentino, Valerio, Javier Luis, and Jordi Cabot. 2016. “Findings from GitHub.” Proc. MSR’16. https://doi.org/10.1145/2901739.2901776.

Costa, Daniel Alencar da, Shane McIntosh, Weiyi Shang, Uira Kulesza, Roberta Coelho, and Ahmed E. Hassan. 2017. “A Framework for Evaluating the Results of the SZZ Approach for Identifying Bug-Introducing Changes.” IEEE Trans. Software Engineering 43 (7). https://doi.org/10.1109/tse.2016.2616306.

Davis, Matthew C., Emad Aghayi, Thomas D. Latoza, Xiaoyin Wang, Brad A. Myers, and Joshua Sunshine. 2023. “What’s (Not) Working in Programmer User Studies?.” ACM Trans. Software Engineering and Methodology 32 (5). https://doi.org/10.1145/3587157.

Devanbu, Prem, Thomas Zimmermann, and Christian Bird. 2016. “Belief & Evidence in Empirical Software Engineering.” Proc. ICSE’16. https://doi.org/10.1145/2884781.2884812.

Diener, Ed, Derrick Wirtz, William Tov, et al. 2010. “New Well-Being Measures: Short Scales to Assess Flourishing and Positive and Negative Feelings.” Social Indicators Research 97: 2010. https://doi.org/10.1007/s11205-009-9493-y.

Elsayed, Nora, Tarek Elhounsri, and Sven Blumberg. 2023. Yes, You Can Measure Software Developer Productivity. https://www.mckinsey.com/industries/technology-media-and-telecommunications/our-insights/yes-you-can-measure-software-developer-productivity.

Emam, K. El, S. Benlarbi, N. Goel, and S. N. Rai. 2001. “The Confounding Effect of Class Size on the Validity of Object-Oriented Metrics.” IEEE Trans. Software Engineering 27 (7). https://doi.org/10.1109/32.935855.

Erdogmus, Hakan, Maurizio Morisio, and Marco Torchiano. 2005. “On the Effectiveness of the Test-First Approach to Programming.” IEEE Trans. Software Engineering 31 (3). https://doi.org/10.1109/tse.2005.37.

Flournoy, John C., Carol S. Lee, Maggie Wu, and Catherine M. Hicks. 2025. No Silver Bullets: Why Understanding Software Cycle Time Is Messy, Not Magic. Vol. 05040. https://doi.org/10.48550/arXiv.2503.05040.

Forsgren, Nicole, Jez Humble, and Gene Kim. 2018. Accelerate: The Science of Lean Software and DevOps. IT Revolution Press.

Forsgren, Nicole, Margaret-Anne Storey, Chandra Maddila, Thomas Zimmermann, Brian Houck, and Jenna Butler. 2021. “The SPACE of Developer Productivity.” ACM Queue 19 (1).

Fu, Yujia, Peng Liang, Amjed Tahir, et al. 2025. “Security Weaknesses of Copilot-Generated Code in GitHub Projects: An Empirical Study.” ACM Trans. Software Engineering and Methodology 34 (8). https://doi.org/10.1145/3716848.

Fucci, Davide, Hakan Erdogmus, Burak Turhan, Markku Oivo, and Natalia Juristo. 2017. “A Dissection of the Test-Driven Development Process: Does It Really Matter to Test-First or to Test-Last?.” IEEE Trans. Software Engineering 43 (7). https://doi.org/10.1109/tse.2016.2616877.

Fucci, Davide, Giuseppe Scanniello, Simone Romano, et al. 2016. “An External Replication on the Effects of Test-Driven Development Using a Multi-Site Blind Analysis Approach.” Proc. ESEM’16. https://doi.org/10.1145/2961111.2962592.

Fucci, Davide, Giuseppe Scanniello, Simone Romano, and Natalia Juristo. 2018. Need for Sleep: The Impact of a Night of Sleep Deprivation on Novice Developers’ Performance. Vol. 02544. https://doi.org/10.48550/arXiv.1805.02544.

Fucci, Davide, Burak Turhan, and Markku Oivo. 2013. “Impact of Process Conformance on the Effects of Test-Driven Development.” Proc. ESEM’13. https://doi.org/10.1109/esem.2013.19.

Girardi, Daniela, Nicole Novielli, Davide Fucci, and Filippo Lanubile. 2020. “Recognizing Developers’ Emotions While Programming.” Proc. ICSE’20. https://doi.org/10.1145/3377811.3380374.

Gold, Nicolas E., and Jens Krinke. 2020. “Ethical Mining.” Proc. MSR’20. https://doi.org/10.1145/3379597.3387462.

Goodhart, Charles. 1984. “Problems of Monetary Management: The u.k. Experience.” Inflation, Depression, and Economic Policy in the West.

Gote, Christoph, Pavlin Mavrodiev, Frank Schweitzer, and Ingo Scholtes. 2022. Big Data = Big Insights? Operationalising Brooks’ Law in a Massive GitHub Data Set. Vol. 04588. https://doi.org/10.48550/arXiv.2201.04588.

Graziotin, Daniel, Fabian Fagerholm, Xiaofeng Wang, and Pekka Abrahamsson. 2018. “What Happens When Software Developers Are (Un)happy.” Journal of Systems and Software 140: 2018. https://doi.org/10.1016/j.jss.2018.02.041.

Haji, Khalid El, Carolin Brandt, and Andy Zaidman. 2024. “Using GitHub Copilot for Test Generation in Python: An Empirical Study.” Proc. AST’24. https://doi.org/10.1145/3644032.3644443.

Hall, Erika. 2019. Just Enough Research. A Book Apart. ISBN 9781952616082.

Harman, Mark, and Bryan F. Jones. 2001. “Search-Based Software Engineering.” Information and Software Technology 43 (14).

Hindle, Abram, Earl T. Barr, Mark Gabel, Zhendong Su, and Premkumar Devanbu. 2016. “On the Naturalness of Software.” Comm. ACM 59 (5). https://doi.org/10.1145/2902362.

Inozemtseva, Laura, and Reid Holmes. 2014. “Coverage Is Not Strongly Correlated with Test Suite Effectiveness.” Proc. ICSE’14. https://doi.org/10.1145/2568225.2568271.

Johnson, Brittany, Yoonki Song, Emerson Murphy-Hill, and Robert Bowdidge. 2013. “Why Don’t Software Developers Use Static Analysis Tools to Find Bugs?” Proc. ICSE’13. https://doi.org/10.1109/icse.2013.6606613.

Juristo, Natalia, and Ana M. Moreno. 2001. Basics of Software Engineering Experimentation. Springer. ISBN 9780792379904.

Kalliamvakou, Eirini, Georgios Gousios, Kelly Blincoe, Leif Singer, Daniel M. German, and Daniela Damian. 2014. “The Promises and Perils of Mining GitHub.” Proc. MSR’14. https://doi.org/10.1145/2597073.2597074.

Kamei, Yasutaka, Emad Shihab, Bram Adams, et al. 2013. “A Large-Scale Empirical Study of Just-in-Time Quality Assurance.” IEEE Trans. Software Engineering 39 (6). https://doi.org/10.1109/tse.2012.70.

Kampenes, Vigdis By, Tore Dybå, Jo Erskine Hannay, and Dag I. K. Sjøberg. 2007. “A Systematic Review of Effect Size in Software Engineering Experiments.” Information and Software Technology.

Ko, Amy J., Robert DeLine, and Gina Venolia. 2007. “Information Needs in Collocated Software Development Teams.” Proc. ICSE’07. https://doi.org/10.1109/icse.2007.45.

Liang, Jenny T., Chenyang Yang, and Brad A. Myers. 2024. “A Large-Scale Survey on the Usability of AI Programming Assistants: Successes and Challenges.” Proc. ICSE’24. https://doi.org/10.1145/3597503.3608128.

Maalej, Walid, Rebecca Tiarks, Tobias Roehm, and Rainer Koschke. 2014. “On the Comprehension of Program Comprehension.” ACM Trans. Software Engineering and Methodology 23 (4). https://doi.org/10.1145/2622669.

Mark, Gloria, Daniela Gudith, and Ulrich Klocke. 2008. “The Cost of Interrupted Work: More Speed and Stress.” Proc. CHI’08.

Medlock, Michael C., Dennis Wixon, Mark Terrano, Ramon Ruflair, and Darrell Vaughan. 2002. “Using the RITE Method to Improve Products: A Definition and a Case Study.” Proc. Usability Professionals Association Conference.

Meyer, André N., Earl T. Barr, Christian Bird, and Thomas Zimmermann. 2021. “Today Was a Good Day: The Daily Life of Software Developers.” IEEE Trans. Software Engineering 47 (5). https://doi.org/10.1109/tse.2019.2904957.

Meyer, André N., Laura E. Barton, Gail C. Murphy, Thomas Zimmermann, and Thomas Fritz. 2017. “The Work Life of Developers: Activities, Switches and Perceived Productivity.” IEEE Trans. Software Engineering 43 (12). https://doi.org/10.1109/tse.2017.2656886.

Miller, Courtney, Rudrajit Choudhuri, Mara Ulloa, et al. 2025. Maybe We Need Some More Examples: Vol. 21280. https://doi.org/10.48550/arXiv.2507.21280.

Mockus, Audris. 2010. “Organizational Volatility and Its Effects on Software Defects.” Proc. SIGSOFT/FSE’10. https://doi.org/10.1145/1882291.1882311.

Muller, Sebastian C., and Thomas Fritz. 2015. “Stuck and Frustrated or in Flow and Happy: Sensing Developers’ Emotions and Progress.” Proc. ICSE’15. https://doi.org/10.1109/icse.2015.334.

Munaiah, Nuthan, Steven Kroh, Craig Cabrey, and Meiyappan Nagappan. 2017. “Curating GitHub for Engineered Software Projects.” Empirical Software Engineering 22 (6). https://doi.org/10.1007/s10664-017-9512-6.

Nagappan, Nachiappan, Brendan Murphy, and Victor Basili. 2008. “The Influence of Organizational Structure on Software Quality: An Empirical Case Study.” Proc. ICSE’08. https://doi.org/10.1145/1368088.1368160.

Newman, Kaia, Madeline Endres, Brittany Johnson, and Westley Weimer. 2023. From Organizations to Individuals: Psychoactive Substance Use by Professional Programmers. Vol. 01056. https://doi.org/10.48550/arXiv.2305.01056.

Nielsen, Jakob, and Thomas K. Landauer. 1993. “A Mathematical Model of the Finding of Usability Problems.” Proc. INTERACT’93 and CHI’93 213: 1993. https://doi.org/10.1145/169059.169166.

Obi, Ike, Jenna Butler, Sankeerti Haniyur, Brian Hassan, Margaret-Anne Storey, and Brendan Murphy. 2024. Identifying Factors Contributing to Bad Days for Software Developers: A Mixed Methods Study. Vol. 18379. https://doi.org/10.48550/arXiv.2410.18379.

Pearce, Hammond, Baleegh Ahmad, Benjamin Tan, Brendan Dolan-Gavitt, and Ramesh Karri. 2022. “Asleep at the Keyboard? Assessing the Security of GitHub Copilot’s Code Contributions.” Proc. S&p’22. https://doi.org/10.1109/SP46214.2022.9833571.

Peng, Sida, Eirini Kalliamvakou, Peter Cihon, and Mert Demirer. 2023. The Impact of AI on Developer Productivity: Evidence from GitHub Copilot. Vol. 06590. https://doi.org/10.48550/arXiv.2302.06590.

Pinto, Manuela Fernández, and Daniel Fernández Pinto. 2023. “Epistemic Diversity and Industrial Selection Bias.” Synthese 201 (5). https://doi.org/10.1007/s11229-023-04158-7.

Prechelt, Lutz. 2000. “An Empirical Comparison of Seven Programming Languages.” IEEE Computer 33 (10). https://doi.org/10.1109/2.876288.

Ray, Baishakhi, Daryl Posnett, Premkumar Devanbu, and Vladimir Filkov. 2017. “A Large-Scale Study of Programming Languages and Code Quality in GitHub.” Comm. ACM 60 (10). https://doi.org/10.1145/3126905.

Risse, Niklas, Jing Liu, and Marcel Böhme. 2025. “Top Score on the Wrong Exam: On Benchmarking in Machine Learning for Vulnerability Detection.” Proc. ACM Software Engineering. https://doi.org/10.1145/3728887.

Ruiz, José Manuel Sánchez, Francisco José Domínguez Mayo, Xavier Oriol, José Francisco Crespo, David Benavides, and Ernest Teniente. 2023. A Benchmarking Proposal for DevOps Practices on Open Source Software Projects. Vol. 14790. https://doi.org/10.48550/arXiv.2304.14790.

Sackman, Harold, W. J. Erikson, and E. E. Grant. 1968. “Exploratory Experimental Studies Comparing Online and Offline Programming Performance.” Comm. ACM 11 (1).

Sadowski, Caitlin, and Thomas Zimmermann (eds.). 2019. Rethinking Productivity in Software Engineering. Apress. ISBN 9781484242216.

Sedano, Todd, Paul Ralph, and Cécile Péraire. 2017. “Software Development Waste.” Proc. ICSE’17. https://doi.org/10.1109/icse.2017.20.

Sillito, J., G. C. Murphy, and K. De Volder. 2008. “Asking and Answering Questions During a Programming Change Task.” IEEE Trans. Software Engineering 34 (4). https://doi.org/10.1109/tse.2008.26.

Silva, Danilo, Nikolaos Tsantalis, and Marco Tulio Valente. 2016. “Why We Refactor? Confessions of GitHub Contributors.” Proc. FSE’16. https://doi.org/10.1145/2950290.2950305.

Spinellis, Diomidis, Panos Louridas, Maria Kechagia, and Tushar Sharma. 2024. Broken Windows: Exploring the Applicability of a Controversial Theory on Code Quality. Vol. 13480. https://doi.org/10.48550/arXiv.2410.13480.

Stapleton, Sean, Yashmeet Gambhir, Alexander LeClair, et al. 2020. “A Human Study of Comprehension and Code Summarization.” Proc. ICPC’20. https://doi.org/10.1145/3387904.3389258.

Storey, Margaret-Anne, Rashina Hoda, Alessandra Maciel Paz Milani, and Maria Teresa Baldassarre. 2024. Guidelines for Using Mixed Methods Research in Software Engineering. Vol. 06011. https://doi.org/10.48550/arXiv.2404.06011.

Storey, Margaret-Anne, Brian Houck, and Thomas Zimmermann. 2022. “How Developers and Managers Define and Trade Productivity for Quality.” Proc. CHASE’22. https://doi.org/10.1145/3528579.3529177.

Thongtanunam, Patanamon, Shane McIntosh, Ahmed E. Hassan, and Hajimu Iida. 2016. “Revisiting Code Ownership and Its Relationship with Software Quality in the Scope of Modern Code Review.” Proc. ICSE’16. https://doi.org/10.1145/2884781.2884852.

Thornberg, Robert, and Kathy Charmaz. 2014. “Grounded Theory and Theoretical Coding.” The SAGE Handbook of Qualitative Data Analysis, ahead of print. https://doi.org/10.4135/9781446282243.

Tregubov, Alexey, Barry Boehm, Natalia Rodchenko, and Jo Ann Lane. 2017. “Impact of Task Switching and Work Interruptions on Software Development Processes.” Proc. ICSSP’17. https://doi.org/10.1145/3084100.3084116.

Treude, Christoph. 2024. Qualitative Data Analysis in Software Engineering: Techniques and Teaching Insights. Vol. 08228. https://doi.org/10.48550/arXiv.2406.08228.

Tufano, Michele, Fabio Palomba, Gabriele Bavota, et al. 2017. “When and Why Your Code Starts to Smell Bad (and Whether the Smells Go Away).” IEEE Trans. Software Engineering 43 (11). https://doi.org/10.1109/tse.2017.2653105.

Uyaguari, Fernando, Silvia T. Acuña, John W. Castro, Davide Fucci, Oscar Dieste, and Sira Vegas. 2024. “Relevant Information in TDD Experiment Reporting.” ACM Trans. Software Engineering and Methodology, ahead of print. https://doi.org/10.1145/3688837.

Vartziotis, Tina, Maximilian Schmidt, George Dasoulas, et al. 2025. Carbon Footprint Evaluation of Code Generation Through LLM as a Service. Vol. 01036. https://doi.org/10.48550/arXiv.2504.01036.

Wessel, Mairieli, Igor Wiese, Igor Steinmacher, and Marco Aurelio Gerosa. 2021. “Don’t Disturb Me: Challenges of Interacting with Software Bots on Open Source Software Projects.” Proc. ACM Human-Computer Interaction. https://doi.org/10.1145/3476042.

Wicherts, J. M., M. Bakker, and D. Molenaar. 2011. “Willingness to Share Research Data Is Related to the Strength of the Evidence and the Quality of Reporting of Statistical Results.” PLoS ONE 6 (11). https://doi.org/10.1371/journal.pone.0026828.

Wohlin, Claes, Per Runeson, Martin Höst, Magnus C. Ohlsson, Björn Regnell, and Anders Wesslén. 2000. Experimentation in Software Engineering: An Introduction. Kluwer Academic Publishers. ISBN 9783662693056.

Wyrich, Marvin. 2023. Source Code Comprehension: A Contemporary Definition and Conceptual Model for Empirical Investigation. Vol. 11301. https://doi.org/10.48550/arXiv.2310.11301.

Zieris, Franz, and Lutz Prechelt. 2014. “On Knowledge Transfer Skill in Pair Programming.” Proc. ESEM’14. https://doi.org/10.1145/2652524.2652529.