Sogol Balali
Marco A. Gerosa
Igor Steinmacher
ABSTRACT
Software developers who want to start contributing to an Open Source Software (OSS) project often struggle to find appropriate first tasks. The voluntary, self-organizing distribution of decentralized labor and the distinct nature of some OSS projects intensifies this challenge. Mentors, who work closely with newcomers, develop strategies to recommend tasks. However, to date neither the challenges mentors face in recommending tasks nor their strategies have been formally documented or studied. In this paper, we interviewed mentors of well-established OSS projects (n=10) and qualitatively analyzed their answers to identify both challenges and strategies related to recommending tasks for newcomers. Then, we employed a survey (n=30) to map the strategies to challenges and collect additional strategies. Our study identified 7 challenges and 13 strategies related to task recommendation. Strategies such as "tagging the issues based on difficulty," "adding documentation," "assigning a small task first and then challenge the newcomers with bigger tasks," and "dividing tasks into smaller pieces" were frequently mentioned as ways to overcome multiple challenges. Our results provide insights for mentors about the strategies OSS communities can use to guide their mentors and for tool builders who design automated support for task assignment.
- Tammy D Allen, Lillian T Eby, Georgia T Chao, and Talya N Bauer. 2017. Taking stock of two relational aspects of organizational life: Tracing the history and shaping the future of socialization and mentoring research. Journal of Applied Psychology 102, 3 (March 2017), 324--337. https://doi.org/10.1037/apl0000086Google Scholar
Cross Ref
- John Anvik and Gail C. Murphy. 2011. Reducing the Effort of Bug Report Triage: Recommenders for Development-oriented Decisions. ACM Trans. Softw. Eng. Methodol. 20, 3, Article 10 (Aug. 2011), 35 pages. https://doi.org/10.1145/2000791.2000794Google ScholarDigital Library
- B. Ashok, Joseph Joy, Hongkang Liang, Sriram K. Rajamani, Gopal Srinivasa, and Vipindeep Vangala. 2009. DebugAdvisor: A Recommender System for Debugging. In Proceedings of the the 7th Joint Meeting of the European Software Engineering Conference and the ACM SIGSOFT Symposium on The Foundations of Software Engineering (ESEC/FSE '09). ACM, New York, NY, USA, 373--382. https://doi.org/10.1145/1595696.1595766Google ScholarDigital Library
- Sogol Balali, Igor Steinmacher, Umayal Annamalai, Anita Sarma, and Marco Aurelio Gerosa. 2018. Newcomers' Barriers... Is That All? An Analysis of Mentors' and Newcomers' Barriers in OSS Projects. Computer Supported Cooperative Work (CSCW) 27, 3 (01 Dec 2018), 679--714. https://doi.org/10.1007/s10606-018-9310-8Google Scholar
- Sebastian Baltes and Stephan Diehl. 2016. Worse than spam: Issues in sampling software developers. In Proceedings of the 10th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement. 1--6.Google ScholarDigital Library
- Sebastian Baltes and Stephan Diehl. 2018. Towards a theory of software development expertise. In ACM Symposium on the Foundations of oftware Engineering (FSE 2018). 187--200.Google ScholarDigital Library
- Ann Barcomb, Klaas-Jan Stol, Brian Fitzgerald, and Dirk Riehle. 2020. Managing Episodic Volunteers in Free/Libre/Open Source Software Communities. IEEE Transactions on Software Engineering (2020).Google Scholar
- Andrew Begel and Beth Simon. 2008. Novice Software Developers, All over Again. In Proceedings of the Fourth International Workshop on Computing Education Research (ICER '08). ACM, New York, NY, USA, 3--14. https://doi.org/10.1145/1404520.1404522Google ScholarDigital Library
- Lucy M. Berlin. 1992. Beyond Program Understanding: A Look at Programming Expertise in Industry. Technical Report HPL-92-142. Hewlett-Packard Laboratories, Palo Alto, CA, USA. http://www.hpl.hp.com/techreports/92/HPL-92-142.html. Accessed in 18 February 2018.Google Scholar
- H Russell Bernard. 2017. Research methods in anthropology: Qualitative and quantitative approaches. Rowman & Littlefield.Google Scholar
- Judith Bishop, Carlos Jensen, Walt Scacchi, and Arfon Smith. 2016. How to Use Open Source Software in Education. In Proceedings of the 47th ACM Technical Symposium on Computing Science Education (SIGCSE '16). ACM, New York, NY, USA, 321--322. https://doi.org/10.1145/2839509.2844665Google ScholarDigital Library
- Kevin Buffardi. 2017. Comparing Remote and Co-located Interaction in Free and Open Source Software Engineering Projects. In Proceedings of the 2017 ACM Conference on Innovation and Technology in Computer Science Education. 22--27.Google ScholarDigital Library
- Margaret Burnett, Anicia Peters, Charles Hill, and Noha Elarief. 2016. Finding Gender-Inclusiveness Software Issues with GenderMag: A Field Investigation. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2586--2598. https://doi.org/10.1145/2858036.2858274Google ScholarDigital Library
- Gerardo Canfora, Massimiliano Di Penta, Rocco Oliveto, and Sebastiano Panichella. 2012. Who is Going to Mentor Newcomers in Open Source Projects?. In Proceedings of the ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering (FSE '12). ACM, New York, NY, USA, Article 44, 11 pages. https://doi.org/10.1145/2393596.2393647Google ScholarDigital Library
- Gloria Crisp and Irene Cruz. 2009. Mentoring college students: A critical review of the literature between 1990 and 2007. Research in higher education 50, 6 (2009), 525--545. https://doi.org/10.1007/s11162-009-9130-2Google Scholar
- Davor Cubranic, Gail C. Murphy, Janice Singer, and Kellogg S. Booth. 2005. Hipikat: a project memory for software development. IEEE Transactions on Software Engineering 31, 6 (June 2005), 446--465.Google ScholarDigital Library
- Jose Ricardo da Silva, Esteban Clua, Leonardo Murta, and Anita Sarma. 2015. Niche vs. breadth: Calculating expertise over time through a fine-grained analysis. In 2015 IEEE 22nd International Conference on Software Analysis, Evolution, and Reengineering (SANER). IEEE, 409--418.Google ScholarCross Ref
- Barthélémy Dagenais, Harold Ossher, Rachel K. E. Bellamy, Martin P. Robillard, and Jacqueline P. de Vries. 2010. Moving into a New Software Project Landscape. In Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 1 (ICSE '10). ACM, New York, NY, USA, 275--284. https://doi.org/10.1145/1806799.1806842Google Scholar
- Amy Edmondson. 1999. Psychological Safety and Learning Behavior in Work Teams Amy Edmondson. Administrative Science Quarterly 44, 2 (1999), 350--383.Google ScholarCross Ref
- Fabian Fagerholm, Alejandro S. Guinea, Jürgen Münch, and Jay Borenstein. 2014. The Role of Mentoring and Project Characteristics for Onboarding in Open Source Software Projects. In ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM '14). ACM, 55:1-55:10. https://doi.org/10.1145/2652524.2652540Google Scholar
- Fabian Fagerholm, Patrik Johnson, Alejandro Sanchez Guinea, Jay Borenstein, and Jürgen Münch. 2014. Onboarding in Open Source Projects. IEEE Software 31, 6 (Nov. 2014), 54--61. https://doi.org/10.1109/MS.2014.107Google ScholarCross Ref
- Yulin Fang and Derrick Neufeld. 2009. Understanding Sustained Participation in Open Source Software Projects. Journal of Management Information Systems 25, 4 (April 2009), 9--50. https://doi.org/10.2753/MIS0742-1222250401Google ScholarDigital Library
- Samer Faraj and Lee Sproull. 2000. Coordinating expertise in software development teams. Management science 46, 12 (2000), 1554--1568.Google Scholar
- N. T. Feather. 1969. Attribution of responsibility and valence of success and failure in relation to initial confidence and task performance. Journal of Personality and Social Psychology 13(2) (1969). https://doi.org/10.1037/h0028071Google Scholar
- Jane Forman and Laura Damschroder. 2007. Qualitative content analysis. Empirical methods for bioethics: A primer 11 (2007), 39--62.Google Scholar
- Andrea Forte and Cliff Lampe. 2013. Defining, Understanding, and Supporting Open Collaboration: Lessons From the Literature. American Behavioral Scientist 57, 5 (2013), 535--547. https://doi.org/10.1177/0002764212469362 arXiv:https://doi.org/10.1177/0002764212469362Google ScholarCross Ref
- D Randy Garrison, Martha Cleveland-Innes, Marguerite Koole, and James Kappelman. 2006. Revisiting methodological issues in transcript analysis: Negotiated coding and reliability. The Internet and Higher Education 9, 1 (2006), 1--8.Google ScholarCross Ref
- Susan Gershenfeld. 2014. A Review of Undergraduate Mentoring Programs. Review of Educational Research 84, 3 (2014), 365--391. https://doi.org/10.3102/0034654313520512 arXiv:https://doi.org/10.3102/0034654313520512Google ScholarCross Ref
- Karen Handley, Andrew Sturdy, Robin Fincham, and Timothy Clark. 2006. Within and beyond communities of practice: Making sense of learning through participation, identity and practice. Journal of management studies 43, 3 (2006), 641--653.Google ScholarCross Ref
- P. N. Johnson-Laird. 1983. Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness. Harvard University Press, Cambridge, MA, USA.Google ScholarDigital Library
- Philip N. Johnson-Laird. 2010. Mental models and human reasoning. Proceedings of the National Academy of Sciences 107, 43 (2010), 18243--18250. https://doi.org/10.1073/pnas.1012933107 arXiv:http://www.pnas.org/content/107/43/18243.full.pdfGoogle ScholarCross Ref
- Swapna Kumar, Melissa Johnson, and Truly Hardemon. 2013. Dissertations at a distance: Students perceptions of online mentoring in a doctoral program. International Journal of E-Learning & Distance Education 27, 1 (2013). http://www.ijede.ca/index.php/jde/article/view/835Google Scholar
- Adriaan Labuschagne and Reid Holmes. 2015. Do Onboarding Programs Work?. In Proceedings of the 12th Working Conference on Mining Software Repositories (MSR '15). IEEE Press, Piscataway, NJ, USA, 381--385. https://doi.org/10.1109/MSR.2015.45Google ScholarDigital Library
- Timothy C Lethbridge. 2000. What knowledge is important to a software professional? Computer 33, 5 (2000), 44--50.Google ScholarDigital Library
- Craig Macdonald and Iadh Ounis. 2006. Voting for candidates: adapting data fusion techniques for an expert search task. In Proceedings of the 15th ACM international conference on Information and knowledge management. ACM, 387--396.Google ScholarDigital Library
- Yuri Malheiros, Alan Moraes, Cleyton Trindade, and Silvio Meira. 2012. A Source Code Recommender System to Support Newcomers. In Proceedings of the IEEE 36th Annual Computer Software and Applications Conference (COMPSAC '12). IEEE, Los Alamitos, California, USA, 19--24. https://doi.org/10.1109/COMPSAC.2012.11Google ScholarDigital Library
- Kay Martinez. 2004. Mentoring New Teachers: Promise and Problems in Times of Teacher Shortage. Australian Journal of Education 48, 1 (2004), 95--108. https://doi.org/10.1177/000494410404800107 arXiv:https://doi.org/10.1177/000494410404800107Google ScholarCross Ref
- Ann Mihkelson. 1997. A Model of Research Mentoring for Higher Education-An Overview. (1997).Google Scholar
- Janice M Morse. 1994. Designing funded qualitative research.. In Handbook of qualitative research. Sage Publications, Inc, 220--335.Google Scholar
- Debora Nascimento, Kenia Cox, Thiago Almeida, Wendell Sampaio, Roberto Bittencourt, Rodrigo Souza, and Christina Chavez. 2013. Using Open Source Projects in software engineering education: A systematic mapping study. In IEEE Frontiers in Education Conference. IEEE, 1837--1843. https://doi.org/10.1109/FIE.2013.6685155Google ScholarCross Ref
- Katherine E Nugent, Gwen Childs, Rosalind Jones, and Pamela Cook. 2004. A mentorship model for the retention of minority students. Nursing Outlook 52, 2 (2004), 89--94. https://doi.org/10.1016/j.outlook.2003.09.008Google ScholarCross Ref
- Gordon O'Brien. 1967. Methods of Analyzing Group Tasks. (1967), 1--40. https://doi.org/dtic/tr/fulltext/u2/647762.pdfGoogle Scholar
- Ilan Oshri, Julia Kotlarsky, and Leslie P Willcocks. 2007. Global software development: Exploring socialization and face-to-face meetings in distributed strategic projects. The Journal of Strategic Information Systems 16, 1 (2007), 25--49.Google ScholarDigital Library
- Sebastiano Panichella. 2015. Supporting newcomers in software development projects. In IEEE International Conference on Software Maintenance and Evolution (ICSME 2015). IEEE, 586--589. https://doi.org/10.1109/ICSM.2015.7332519Google ScholarDigital Library
- Yunrim Park and Carlos Jensen. 2009. Beyond pretty pictures: Examining the benefits of code visualization for open source newcomers. In Proceedings of the 5th IEEE International Workshop on Visualizing Software for Understanding and Analysis (VISSOFT '09). IEEE, 3--10.Google ScholarCross Ref
- Stephanie C Payne and Ann H Huffman. 2005. A longitudinal examination of the influence of mentoring on organizational commitment and turnover. Academy of Management Journal 48, 1 (February 2005), 158--168. https://doi.org/10.5465/AMJ.2005.15993166Google ScholarCross Ref
- Gustavo Pinto, Igor Steinmacher, Fernando Figueira Filho, and Marco A. Gerosa. 2017. Training the Next Generation of Software Engineers using Open-Source Software: An Interview Study. In IEEE 30th International Conference on Software Engineering Education and Training (CSEET 2017). IEEE, Los Alamitos, California, USA, 5.Google Scholar
- Gustavo Pinto, Igor Steinmacher, and Marco Gerosa. 2016. More Common Than You Think: An In-Depth Study of Casual Contributors. In SANER. 112--123.Google Scholar
- Alex Radermacher and Gursimran Walia. 2013. Gaps between industry expectations and the abilities of graduates. In Proceeding of the 44th ACM technical symposium on Computer science education. 525--530.Google Scholar
- Belle Rose Ragins. 1989. Barriers to Mentoring: The Female Manager's Dilemma. Human Relations 42, 1 (January 1989), 1--22. https://doi.org/10.1177/001872678904200101Google ScholarCross Ref
- Donna Redman, Sharon Conley, and Terrence E. Deal. 2015. A cultural approach to mentoring new teachers. In Mentoring for school quality: How educators can be more professional and effective, Bruce S. Cooper and Carlos R. McCray (Eds.). Rowman & Littlefield, Lanham, Maryland, 65--80.Google Scholar
- Jonah E Rockoff. 2008. Does mentoring reduce turnover and improve skills of new employees? Evidence from teachers in New York City. Technical Report. National Bureau of Economic Research.Google Scholar
- Neil J Salkind. 2008. Encyclopedia of educational psychology. Sage Publications.Google Scholar
- Anita Sarma, Xiaofan Chen, Sandeep Kuttal, Laura Dabbish, and Zhendong Wang. 2016. Hiring in the Global Stage: Profiles of Online Contributions. In 2016 IEEE 11th International Conference on Global Software Engineering (ICGSE). 1--10. https://doi.org/10.1109/ICGSE.2016.35Google Scholar
- Anita Sarma, Marco Aurélio Gerosa, Igor Steinmacher, and Rafael Leano. 2016. Training the Future Workforce Through Task Curation in an OSS Ecosystem. In 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering (FSE 2016). ACM, New York, NY, USA, 932--935. https://doi.org/10.1145/2950290.2983984Google ScholarDigital Library
- Andreas Schilling, Sven Laumer, and Tim Weitzel. 2012. Who Will Remain? An Evaluation of Actual Person-Job and Person-Team Fit to Predict Developer Retention in FLOSS Projects. In Proceedings of the 2012 45th Hawaii International Conference on System Sciences (HICSS '12). IEEE Computer Society, 3446--3455. https://doi.org/10.1109/HICSS.2012.644Google ScholarDigital Library
- Jefferson Silva, Igor Wiese, Daniel German, Christoph Treude, Marco Gerosa, and Igor Steinmacher. 2020. A Theory of the Engagement in Open Source Projects via Summer of Code Programs. In Proceedings of the ACM Symposium on the Foundations of Software Engineering (FSE 2020) (FSE '20).Google ScholarDigital Library
- Susan E. Sim and Richard C. Holt. 1998. The ramp-up problem in software projects: a case study of how software immigrants naturalize. In Proceedings of the 20th International Conference on Software Engineering (ICSE '98). IEEE, 361--370. https://doi.org/10.1109/ICSE.1998.671389Google Scholar
- Donna Spencer. 2009. Card sorting: Designing usable categories. Rosenfeld Media.Google Scholar
- Igor Steinmacher, Ana Paula Chaves, and Marco Aurélio Gerosa. 2013. Awareness Support in Distributed Software Development: A Systematic Review and Mapping of the Literature. Computer Supported Cooperative Work (CSCW) 22, 2-3 (2013), 113--158. https://doi.org/10.1007/s10606-012-9164-4Google ScholarDigital Library
- Igor Steinmacher, Tayana Conte, and Marco Aurélio Gerosa. 2015. Understanding and Supporting the Choice of an Appropriate Task to Start With In Open Source Software Communities. In 2015 48th Hawaii International Conference on System Sciences (HICSS '15). IEEE, 5299--5308.Google ScholarDigital Library
- Igor Steinmacher, Tayana Conte, Marco Aurélio Gerosa, and David F. Redmiles. 2015. Social Barriers Faced by Newcomers Placing Their First Contribution in Open Source Software Projects. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15). ACM, New York, NY, USA, 1379--1392. http://doi.acm.org/10.1145/2675133.2675215Google Scholar
- Igor Steinmacher, Tayana Uchoa Conte, Christoph Treude, and Marco Aurélio Gerosa. 2016. Overcoming Open Source Project Entry Barriers with a Portal for Newcomers. In 38th International Conference on Software Engineering (ICSE '16). ACM, New York, NY, USA, 273--284. https://doi.org/0.1145/2884781.2884806Google ScholarDigital Library
- Igor Steinmacher, Christoph Treude, and Marco Gerosa. 2018. Let me in: Guidelines for the Successful Onboarding of Newcomers to Open Source Projects. IEEE Software (2018), 1--1. https://doi.org/10.1109/MS.2018.110162131Google Scholar
- Igor Steinmacher, Igor Scaliante Wiese, and Marco Aurélio Gerosa. 2012. Recommending mentors to software project newcomers. In Proceedings of the Third International Workshop on Recommendation Systems for Software Engineering (RSSE '12). IEEE Computer Society, Washington, DC, USA, 63--67. https://doi.org/10.1109/RSSE.2012.6233413Google ScholarDigital Library
- Heidrun Stoeger, Xiaoju Duan, Sigrun Schirner, Teresa Greindl, and Albert Ziegler. 2013. The effectiveness of a one-year online mentoring program for girls in STEM. Computers & Education 69 (2013), 408--418.Google ScholarDigital Library
- Margaret-Anne Storey, Alexey Zagalsky, Fernando Figueira Filho, Leif Singer, and Daniel M German. 2016. How social and communication channels shape and challenge a participatory culture in software development. IEEE Transactions on Software Engineering 43, 2 (2016), 185--204.Google ScholarDigital Library
- Anselm Strauss and Juliet M. Corbin. 2007. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory (3rd ed.). SAGE Publications.Google Scholar
- Chris Street. 2004. Examining Learning To Teach through a Social Lens: How Mentors Guide Newcomers into a Professional Commuity of Learners. Teacher Education Quarterly 31, 2 (2004), 7--24.Google Scholar
- Gil Taran and Lynn Carter. 2010. Improving distance mentoring: Challenges and how to deal with them in global development project courses. In Conference on Software Engineering Education and Training (CSEET). IEEE, 97--104.Google ScholarDigital Library
- Erik H Trainer, Arun Kalyanasundaram, and James D Herbsleb. 2017. E-mentoring for software engineering: a socio-technical perspective. In 2017 IEEE/ACM 39th International Conference on Software Engineering: Software Engineering Education and Training Track (ICSE-SEET). IEEE, 107--116.Google ScholarDigital Library
- Georg von Krogh, Sebastian Spaeth, and Karim R. Lakhani. 2003. Community, joining, and specialization in open source software innovation: A case study. Research Policy 32, 7 (2003), 1217--1241.Google ScholarCross Ref
- Jianguo Wang and Anita Sarma. 2011. Which bug should I fix: helping new developers onboard a new project. In Proceedings of the 4th International Workshop on Cooperative and Human Aspects of Software Engineering (CHASE '11). ACM, New York, NY, USA, 76--79.Google ScholarDigital Library
- Vincent Wolff-Marting, Christoph Hannebauer, and Volker Gruhn. 2013. Patterns for tearing down contribution barriers to FLOSS projects. In Proceedings of the 12th International Conference on Intelligent Software Methodologies, Tools and Techniques (SoMeT '13). IEEE, 9--14. https://doi.org/10.1109/SoMeT.2013.6645669Google ScholarCross Ref
- Frances Zlotnick. 2017. GitHub Open Source Survey 2017. http://opensourcesurvey.org/2017/. (jun 2017). https://doi.org/10.5281/zenodo.806811Google Scholar
Index Terms
- Recommending Tasks to Newcomers in OSS Projects: How Do Mentors Handle It?
Recommendations
A theory of the engagement in open source projects via summer of code programs
ESEC/FSE 2020: Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software EngineeringSummer of code programs connect students to open source software (OSS) projects, typically during the summer break from school. Analyzing consolidated summer of code programs can reveal how college students, who these programs usually target, can be ...
Recommending mentors to software project newcomers
RSSE '12: Proceedings of the Third International Workshop on Recommendation Systems for Software EngineeringOpen Source Software projects success depends on the continuous influx of newcomers and their contributions. Newcomers play an important role as they are the potential future developers, but they face difficulties and obstacles when initiating their ...
Understanding the impressions, motivations, and barriers of one time code contributors to FLOSS projects: a survey
ICSE '17: Proceedings of the 39th International Conference on Software EngineeringSuccessful Free/Libre Open Source Software (FLOSS) projects must attract and retain high-quality talent. Researchers have invested considerable effort in the study of core and peripheral FLOSS developers. To this point, one critical subset of developers ...
Comments