Skip to main content
Top
Published in: Wireless Personal Communications 4/2020

30-05-2020

Design of Programmer’s Skill Evaluation Metrics for Effective Team Selection

Author: Kapil Juneja

Published in: Wireless Personal Communications | Issue 4/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Software projects are now developed in critical environments with hard restrictions and contesting limitations. For developing a product under deadline, cost, and quality constraints, extraordinary efforts are required. The team selection is the part of software planning to avoid the time, cost, and maintenance overheads. This paper has provided five metrics to measure the aspects of the programmer’s capabilities. The metrics are provided to measure the technical capability, experience, bug resistivity, coding capability, and learning interests of programmers. Each measure of programmer capability is based on multiple sub-features. These features and sub-features are evaluated based on the rating collected from the programmer, group members, and the team leader. Each team member submits his view to rate the programmer’s adaptation to specific features. The rating of each co-programmer is evaluated under the light of precise distinctive weight. The weights are assigned based on the feature and its dependency and knowledge of the team members. The evaluated feature weights are finally applied under high-level capability metrics to measure the programmer’s strength for that feature. After generating the individual capability measure, the aggregate operators are applied to conclude the capability of the programmer. At the final stage, the rule-based decision criteria are defined to distinguish the expert, skilled, and low-performance programmers. The experimental data are collected by conducting a survey on five teams of programmers with overall 30 programmers. The proposed metrics adaptive model can improve the decision criteria for the selection of team members for specific projects.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Gulati, J., Bhardwaj, P., Suri, B., & Lather, A. S. (2016). A study of relationship between performance, temperament and personality of a software programmer. SIGSOFT Software Engineering Notes, 41, 1–5.CrossRef Gulati, J., Bhardwaj, P., Suri, B., & Lather, A. S. (2016). A study of relationship between performance, temperament and personality of a software programmer. SIGSOFT Software Engineering Notes, 41, 1–5.CrossRef
2.
go back to reference Magnaudet, M., Chatty, S. (2014). What should adaptivity mean to interactive software programmers?. In SIGCHI symposium on Engineering interactive computing systems, pp. 13–22. Magnaudet, M., Chatty, S. (2014). What should adaptivity mean to interactive software programmers?. In SIGCHI symposium on Engineering interactive computing systems, pp. 13–22.
3.
go back to reference Khan, I. A., Hierons, R. M., Brinkman, W.-P. (2006). Programmer’s mood and their performance. In 13th Eurpoean conference on Cognitive ergonomics: trust and control in complex socio-technical systems, pp. 123–124. Khan, I. A., Hierons, R. M., Brinkman, W.-P. (2006). Programmer’s mood and their performance. In 13th Eurpoean conference on Cognitive ergonomics: trust and control in complex socio-technical systems, pp. 123–124.
4.
go back to reference Douce, C., Livingstone, D., & Orwell, J. (2005). Automatic test-based assessment of programming: A review. Journal on Educational Resources in Computing, 5(3), 4.CrossRef Douce, C., Livingstone, D., & Orwell, J. (2005). Automatic test-based assessment of programming: A review. Journal on Educational Resources in Computing, 5(3), 4.CrossRef
5.
go back to reference DeMarco, T., Lister, T. (1985). Programmer performance and the effects of the workplace. In 8th international conference on Software engineering, pp. 268–272. DeMarco, T., Lister, T. (1985). Programmer performance and the effects of the workplace. In 8th international conference on Software engineering, pp. 268–272.
6.
go back to reference Joseph, H. R. (2014). Software programmer management: a machine learning and human computer interaction framework for optimal task assignment. In SIGSOFT International Symposium on Foundations of Software Engineering, pp. 826–828. Joseph, H. R. (2014). Software programmer management: a machine learning and human computer interaction framework for optimal task assignment. In SIGSOFT International Symposium on Foundations of Software Engineering, pp. 826–828.
7.
go back to reference Cheney, P. H. (1984). Effects of individual characteristics, organizational factors and task characteristics on computer programmer productivity and job satisfaction. Information & Management, 7(4), 209–214.CrossRef Cheney, P. H. (1984). Effects of individual characteristics, organizational factors and task characteristics on computer programmer productivity and job satisfaction. Information & Management, 7(4), 209–214.CrossRef
8.
go back to reference Paunonen, S. V., & Jackson, D. N. (1987). Accuracy of interviewers and students in identifying the personality characteristics of personnel managers and computer programmers. Journal of Vocational Behavior, 31(1), 26–36.CrossRef Paunonen, S. V., & Jackson, D. N. (1987). Accuracy of interviewers and students in identifying the personality characteristics of personnel managers and computer programmers. Journal of Vocational Behavior, 31(1), 26–36.CrossRef
9.
go back to reference Baehr, M. E., & Orban, J. A. (1989). The role of intellectual abilities and personality characteristics in determining success in higher-level positions. Journal of Vocational Behavior, 35(3), 270–287.CrossRef Baehr, M. E., & Orban, J. A. (1989). The role of intellectual abilities and personality characteristics in determining success in higher-level positions. Journal of Vocational Behavior, 35(3), 270–287.CrossRef
10.
go back to reference Capretz, L. F. (2003). Personality types in software engineering. International Journal of Human-Computer Studies, 58(2), 207–214.CrossRef Capretz, L. F. (2003). Personality types in software engineering. International Journal of Human-Computer Studies, 58(2), 207–214.CrossRef
11.
go back to reference Ahmed, F., Campbell, P., Jaffar, A., & Alkobaisi, S. (2010). Learning & personality types: A case study of a software design course. Journal of Information Technology Eduction: Innovations in Practice, 9, 237–252. Ahmed, F., Campbell, P., Jaffar, A., & Alkobaisi, S. (2010). Learning & personality types: A case study of a software design course. Journal of Information Technology Eduction: Innovations in Practice, 9, 237–252.
12.
go back to reference Feldt, R., Torkar, R., Angelis, L., & Samuelsson, M. (2008). Towards individualized software engineering: Empirical studies should collect psychometrics. In International workshop on Cooperative and human aspects of software engineering, pp. 49–52. Feldt, R., Torkar, R., Angelis, L., & Samuelsson, M. (2008). Towards individualized software engineering: Empirical studies should collect psychometrics. In International workshop on Cooperative and human aspects of software engineering, pp. 49–52.
13.
go back to reference Tejaswini, et al. (2017). Programmer Productivity Analyzer Tool. In IEEE International Conference on Computational Intelligence and Computing Research (ICCIC), pp. 1–8. Tejaswini, et al. (2017). Programmer Productivity Analyzer Tool. In IEEE International Conference on Computational Intelligence and Computing Research (ICCIC), pp. 1–8.
14.
go back to reference Li, X., Shih, P.-C., & David, E. (2018). The effect of software programmers’ personality on programming performance. In International Conference on Artificial Intelligence and Big Data (ICAIBD), pp. 209–213. Li, X., Shih, P.-C., & David, E. (2018). The effect of software programmers’ personality on programming performance. In International Conference on Artificial Intelligence and Big Data (ICAIBD), pp. 209–213.
15.
go back to reference Feldt, R., Angelis, L., Torkar, R., & Samuelsson, M. (2010). Links between the personalities, views and attitudes of software engineers. Information and Software Technology, 52(6), 611–624.CrossRef Feldt, R., Angelis, L., Torkar, R., & Samuelsson, M. (2010). Links between the personalities, views and attitudes of software engineers. Information and Software Technology, 52(6), 611–624.CrossRef
16.
go back to reference Goldberg, L. R., et al. (2006). The international personality item pool and the future of public-domain personality measures. Journal of Research in Personality, 40(1), 84–96.CrossRef Goldberg, L. R., et al. (2006). The international personality item pool and the future of public-domain personality measures. Journal of Research in Personality, 40(1), 84–96.CrossRef
17.
go back to reference Wang, Y. (2009). Building the linkage between project managers’ personality and success of software projects. In 3rd International Symposium on Empirical Software Engineering and Measurement, pp. 410–413. Wang, Y. (2009). Building the linkage between project managers’ personality and success of software projects. In 3rd International Symposium on Empirical Software Engineering and Measurement, pp. 410–413.
18.
go back to reference Kosti, M. V., Feldt, R., & Angelis, L. (2014). Personality, emotional intelligence and work preferences in software engineering: An empirical study. Information and Software Technology, 56(8), 973–990.CrossRef Kosti, M. V., Feldt, R., & Angelis, L. (2014). Personality, emotional intelligence and work preferences in software engineering: An empirical study. Information and Software Technology, 56(8), 973–990.CrossRef
19.
go back to reference Cruz, S., da Silva, F. Q. B., & Capretz, L. F. (2015). Forty years of research on personality in software engineering: A mapping study. Computers in Human Behavior, 46, 94–113.CrossRef Cruz, S., da Silva, F. Q. B., & Capretz, L. F. (2015). Forty years of research on personality in software engineering: A mapping study. Computers in Human Behavior, 46, 94–113.CrossRef
20.
go back to reference Yilmaz, M., O’Connor, R. V., Colomo-Palacios, R., & Clarke, P. (2017). An examination of personality traits and how they impact on software development teams. Information and Software Technology, 86, 101–122.CrossRef Yilmaz, M., O’Connor, R. V., Colomo-Palacios, R., & Clarke, P. (2017). An examination of personality traits and how they impact on software development teams. Information and Software Technology, 86, 101–122.CrossRef
21.
go back to reference Fitria, & Nugraha, I. G. B. B. (2018). Formation of software programmer team based on skill interdependency. In International Conference on Information Technology Systems and Innovation (ICITSI), pp. 77–81. Fitria, & Nugraha, I. G. B. B. (2018). Formation of software programmer team based on skill interdependency. In International Conference on Information Technology Systems and Innovation (ICITSI), pp. 77–81.
22.
go back to reference Dieste, O., et al. (2018). Empirical evaluation of the effects of experience on code quality and programmer productivity: An exploratory study. In International Conference on Software and System Process, pp. 111–112. Dieste, O., et al. (2018). Empirical evaluation of the effects of experience on code quality and programmer productivity: An exploratory study. In International Conference on Software and System Process, pp. 111–112.
23.
go back to reference Ajibade, S.-S. M., Ahmad, N. B., Shamsuddin, S. M. (2019). An heuristic feature selection algorithm to evaluate academic performance of students. In 10th Control and System Graduate Research Colloquium (ICSGRC), pp. 110–114. Ajibade, S.-S. M., Ahmad, N. B., Shamsuddin, S. M. (2019). An heuristic feature selection algorithm to evaluate academic performance of students. In 10th Control and System Graduate Research Colloquium (ICSGRC), pp. 110–114.
24.
go back to reference Zulfahri, A. F., Widodo, C. E., & Gernowo, R. (2019). Implementing Importance-Performance Analysis (IPA) for measuring students satisfaction levels. In International Seminar on Research of Information Technology and Intelligent Systems (ISRITI), pp. 363–367. Zulfahri, A. F., Widodo, C. E., & Gernowo, R. (2019). Implementing Importance-Performance Analysis (IPA) for measuring students satisfaction levels. In International Seminar on Research of Information Technology and Intelligent Systems (ISRITI), pp. 363–367.
25.
go back to reference Denny, J., Rubeena, M. M., & Denny, J. K. (2019). A noval approach for predicting the academic performance of student. In IEEE International Conference on Electrical, Computer and Communication Technologies (ICECCT), pp. 1–5. Denny, J., Rubeena, M. M., & Denny, J. K. (2019). A noval approach for predicting the academic performance of student. In IEEE International Conference on Electrical, Computer and Communication Technologies (ICECCT), pp. 1–5.
26.
go back to reference Korukonda, A. R. (2005). Personality, individual characteristics, and predisposition to technophobia: Some answers, questions, and points to ponder about. Information Sciences, 170(2), 309–328.CrossRef Korukonda, A. R. (2005). Personality, individual characteristics, and predisposition to technophobia: Some answers, questions, and points to ponder about. Information Sciences, 170(2), 309–328.CrossRef
27.
go back to reference Tett, R. P., Freund, K. A., Christiansen, N. D., Fox, K. E., & Coaster, J. (2012). Faking on self-report emotional intelligence and personality tests: Effects of faking opportunity, cognitive ability, and job type. Personality and Individual Differences, 52(2), 195–201.CrossRef Tett, R. P., Freund, K. A., Christiansen, N. D., Fox, K. E., & Coaster, J. (2012). Faking on self-report emotional intelligence and personality tests: Effects of faking opportunity, cognitive ability, and job type. Personality and Individual Differences, 52(2), 195–201.CrossRef
28.
go back to reference Gilal, A. R., Jaafar, J., Omar, M., Basri, S., & Aziz, I. D. A. (2019). A set of rules for constructing gender-based personality types’ composition for software programmer. In International Conference on Data Engineering, pp. 363–374. Gilal, A. R., Jaafar, J., Omar, M., Basri, S., & Aziz, I. D. A. (2019). A set of rules for constructing gender-based personality types’ composition for software programmer. In International Conference on Data Engineering, pp. 363–374.
29.
go back to reference Ortin, F., Rodriguez-Prieto, O., Pascual, N., & Garcia, M. (2020). Heterogeneous tree structure classification to label Java programmers according to their expertise level. Future Generation Computer Systems, 105, 380–394.CrossRef Ortin, F., Rodriguez-Prieto, O., Pascual, N., & Garcia, M. (2020). Heterogeneous tree structure classification to label Java programmers according to their expertise level. Future Generation Computer Systems, 105, 380–394.CrossRef
30.
go back to reference Lather, A. S., Kumar, S., & Singh, Y. (2000). Suitability assessment of software developers: A fuzzy approach. SIGSOFT Software Engineering Notes, 25(3), 30–31.CrossRef Lather, A. S., Kumar, S., & Singh, Y. (2000). Suitability assessment of software developers: A fuzzy approach. SIGSOFT Software Engineering Notes, 25(3), 30–31.CrossRef
31.
go back to reference Mazni, O., Syed-Abdullah, S. L., & Hussin, N. M. (2010). Analyzing personality types to predict team performance. In International Conference on Science and Social Research, pp. 624–628. Mazni, O., Syed-Abdullah, S. L., & Hussin, N. M. (2010). Analyzing personality types to predict team performance. In International Conference on Science and Social Research, pp. 624–628.
32.
go back to reference Varona, D., Capretz, L. F., Pinero, Y., & Raza, A. (2012). Evolution of software engineers’ personality profile. SIGSOFT Software Engineering Notes, 37(1), 1–5.CrossRef Varona, D., Capretz, L. F., Pinero, Y., & Raza, A. (2012). Evolution of software engineers’ personality profile. SIGSOFT Software Engineering Notes, 37(1), 1–5.CrossRef
33.
go back to reference Varona, D., Lizama-Mue, Y., & Capretz, L. F. (2014). A comparison of junior and senior software engineering students’ personalities. In 7th International Workshop on Cooperative and Human Aspects of Software Engineering, pp. 131–132. Varona, D., Lizama-Mue, Y., & Capretz, L. F. (2014). A comparison of junior and senior software engineering students’ personalities. In 7th International Workshop on Cooperative and Human Aspects of Software Engineering, pp. 131–132.
34.
go back to reference Gilal, A. R., Jaafar, J., Omar, M., Basri, S., & Waqas, A. (2016). A rule-based model for software development team composition: Team leader role with personality types and gender classification. Information and Software Technology, 74, 105–113.CrossRef Gilal, A. R., Jaafar, J., Omar, M., Basri, S., & Waqas, A. (2016). A rule-based model for software development team composition: Team leader role with personality types and gender classification. Information and Software Technology, 74, 105–113.CrossRef
35.
go back to reference Sfetsos, P., Adamidis, P., Angelis, L., Stamelos, I., & Deligiannis, I. (2012). Investigating the impact of personality and temperament traits on pair programming: A controlled experiment replication. In Eighth International Conference on the Quality of Information and Communications Technology, pp. 57–65. Sfetsos, P., Adamidis, P., Angelis, L., Stamelos, I., & Deligiannis, I. (2012). Investigating the impact of personality and temperament traits on pair programming: A controlled experiment replication. In Eighth International Conference on the Quality of Information and Communications Technology, pp. 57–65.
36.
go back to reference Salleh, N., Mendes, E., & Grundy, J. (2014). Investigating the effects of personality traits on pair programming in a higher education setting through a family of experiments. Empirical Software Engineering, 19(3), 714–752.CrossRef Salleh, N., Mendes, E., & Grundy, J. (2014). Investigating the effects of personality traits on pair programming in a higher education setting through a family of experiments. Empirical Software Engineering, 19(3), 714–752.CrossRef
37.
go back to reference Acuña, S. T., Gómez, M., & Juristo, N. (2009). How do personality, team processes and task characteristics relate to job satisfaction and software quality? Information and Software Technology, 51(3), 627–639.CrossRef Acuña, S. T., Gómez, M., & Juristo, N. (2009). How do personality, team processes and task characteristics relate to job satisfaction and software quality? Information and Software Technology, 51(3), 627–639.CrossRef
38.
go back to reference Schaefer, R. (2006). A critical programmer searches for professionalism. SIGSOFT Software Engineering Notes, 31(4), 1–17.MathSciNetCrossRef Schaefer, R. (2006). A critical programmer searches for professionalism. SIGSOFT Software Engineering Notes, 31(4), 1–17.MathSciNetCrossRef
39.
go back to reference Shepherd, D. C., & Murphy, G. C. (2008). A sketch of the programmer’s coach: Making programmers more effective. In International workshop on Cooperative and human aspects of software engineering, pp. 97–100. Shepherd, D. C., & Murphy, G. C. (2008). A sketch of the programmer’s coach: Making programmers more effective. In International workshop on Cooperative and human aspects of software engineering, pp. 97–100.
40.
go back to reference Whalley, J. L., & Philpott, A. (2011). A unit testing approach to building novice programmers’ skills and confidence. In Thirteenth Australasian Computing Education Conference, pp. 113–118. Whalley, J. L., & Philpott, A. (2011). A unit testing approach to building novice programmers’ skills and confidence. In Thirteenth Australasian Computing Education Conference, pp. 113–118.
41.
go back to reference Rodrigo, M. M. T., et al. (2009). Affective and behavioral predictors of novice programmer achievement. SIGCSE Bulletin, 41(3), 156–160.CrossRef Rodrigo, M. M. T., et al. (2009). Affective and behavioral predictors of novice programmer achievement. SIGCSE Bulletin, 41(3), 156–160.CrossRef
42.
go back to reference Shuhidan, S. M., Hamilton, M., & D’Souza, D. (2011). Understanding novice programmer difficulties via guided learning. In 16th annual joint conference on Innovation and technology in computer science education, pp. 213–217. Shuhidan, S. M., Hamilton, M., & D’Souza, D. (2011). Understanding novice programmer difficulties via guided learning. In 16th annual joint conference on Innovation and technology in computer science education, pp. 213–217.
43.
go back to reference Gilal, A. R., Jaafar, J., Basri, S., Omar, M., & Tunio, M. Z. (2015). Making programmer suitable for team-leader: Software team composition based on personality types. In International symposium on mathematical sciences and computing research, pp. 78–82. Gilal, A. R., Jaafar, J., Basri, S., Omar, M., & Tunio, M. Z. (2015). Making programmer suitable for team-leader: Software team composition based on personality types. In International symposium on mathematical sciences and computing research, pp. 78–82.
44.
go back to reference Amin, A., Rehman, M., Basri, S., & Hassan, M. F. (2015). A proposed conceptual framework of programmer’s creativity. In International symposium on technology management and emerging technologies, pp. 108–113. Amin, A., Rehman, M., Basri, S., & Hassan, M. F. (2015). A proposed conceptual framework of programmer’s creativity. In International symposium on technology management and emerging technologies, pp. 108–113.
45.
go back to reference Somasundaram, T. S., Kiruthika, U., Gowsalya, M., Hemalatha, A., & Philips, A. (2015). Determination of competency of programmers by classification and ranking using AHP. In International conference on electro/information technology, pp. 194–200. Somasundaram, T. S., Kiruthika, U., Gowsalya, M., Hemalatha, A., & Philips, A. (2015). Determination of competency of programmers by classification and ranking using AHP. In International conference on electro/information technology, pp. 194–200.
46.
go back to reference Reinstedt, R. N. (1967). Results of a programmer performance prediction study. Transactions on Engineering Management, 14(4), 183–187.CrossRef Reinstedt, R. N. (1967). Results of a programmer performance prediction study. Transactions on Engineering Management, 14(4), 183–187.CrossRef
47.
go back to reference Katzmarski, B., & Koschke, R. (2012). Program complexity metrics and programmer opinions. In International Conference on Program Comprehension, pp. 17–26. Katzmarski, B., & Koschke, R. (2012). Program complexity metrics and programmer opinions. In International Conference on Program Comprehension, pp. 17–26.
48.
go back to reference Solla, M., Patel, A., & Wills, C. (2011). New metric for measuring programmer productivity. In Symposium on Computers & Informatics, pp. 177–182. Solla, M., Patel, A., & Wills, C. (2011). New metric for measuring programmer productivity. In Symposium on Computers & Informatics, pp. 177–182.
49.
go back to reference Harrison, W. (1989). PDSS: A programmer’s decision support system. Data & Knowledge Engineering, 4(2), 115–123.CrossRef Harrison, W. (1989). PDSS: A programmer’s decision support system. Data & Knowledge Engineering, 4(2), 115–123.CrossRef
50.
go back to reference Kemayel, L., Mili, A., & Ouederni, I. (1991). Controllable factors for programmer productivity: A statistical study. Journal of Systems and Software, 16(2), 151–163.CrossRef Kemayel, L., Mili, A., & Ouederni, I. (1991). Controllable factors for programmer productivity: A statistical study. Journal of Systems and Software, 16(2), 151–163.CrossRef
Metadata
Title
Design of Programmer’s Skill Evaluation Metrics for Effective Team Selection
Author
Kapil Juneja
Publication date
30-05-2020
Publisher
Springer US
Published in
Wireless Personal Communications / Issue 4/2020
Print ISSN: 0929-6212
Electronic ISSN: 1572-834X
DOI
https://doi.org/10.1007/s11277-020-07517-6

Other articles of this Issue 4/2020

Wireless Personal Communications 4/2020 Go to the issue