Skip to main content
Erschienen in: Discover Computing 3/2021

02.04.2021

Improved reviewer assignment based on both word and semantic features

verfasst von: Shicheng Tan, Zhen Duan, Shu Zhao, Jie Chen, Yanping Zhang

Erschienen in: Discover Computing | Ausgabe 3/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Assigning appropriate reviewers to a manuscript from a pool of candidate reviewers is a common challenge in the academic community. Current word- and semantic-based approaches treat the reviewer assignment problem (RAP) as an information retrieval problem but do not take into account two constraints of the RAP: incompleteness of the reviewer data and interference from nonmanuscript-related papers. In this paper, a word and semantic-based iterative model (WSIM) is proposed to account for the constraints of the RAP by improving the similarity calculations between reviewers and manuscripts. First, we use the improved language model and topic model to extract word features and semantic features to represent reviewers and manuscripts. Second, we use a similarity metric based on the normalized discounted cumulative gain (NDCG) to measure semantic similarity. This metric ignores the probability value (quantitative exact value) of the topic and considers only the ranking (qualitative relevance), thus reducing overfitting to incomplete reviewer data. Finally, we use an iterative model to reduce the interference from nonmanuscript-related papers in the reviewer data. This approach considers the similarity between the manuscript and each of the reviewer’s papers. We evaluate the proposed WSIM on two real datasets and compare its performance to that of seven existing methods. The experimental results show that the WSIM improves the recommendation accuracy by at least 2.5% on the top 20.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Anaya, Antonio R., Luque, Manuel, Letón, Emilio, & Hernández-del-Olmo, Félix. (2019). Automatic assignment of reviewers in an online peer assessment task based on social interactions. Expert Systems with Applications, 36(4), e12405. (ISSN 0266-4720.). Anaya, Antonio R., Luque, Manuel, Letón, Emilio, & Hernández-del-Olmo, Félix. (2019). Automatic assignment of reviewers in an online peer assessment task based on social interactions. Expert Systems with Applications, 36(4), e12405. (ISSN 0266-4720.).
Zurück zum Zitat Basu, Chumki, Hirsh, Haym, Cohen, William W., & Nevill-Manning, Craig. (2001). Technical paper recommendation: A study in combining multiple information sources. Journal of Artificial Intelligence Research, 14, 231–252.CrossRef Basu, Chumki, Hirsh, Haym, Cohen, William W., & Nevill-Manning, Craig. (2001). Technical paper recommendation: A study in combining multiple information sources. Journal of Artificial Intelligence Research, 14, 231–252.CrossRef
Zurück zum Zitat Bergstra, James, & Bengio, Yoshua. (2012). Random search for hyper-parameter optimization. Journal of machine learning research, 13(2), 281–305.MathSciNetMATH Bergstra, James, & Bengio, Yoshua. (2012). Random search for hyper-parameter optimization. Journal of machine learning research, 13(2), 281–305.MathSciNetMATH
Zurück zum Zitat Biswas, Humayun Kabir & Hasan, Md Maruf. (2007). Using publications and domain knowledge to build research profiles: An application in automatic reviewer assignment. In Information and Communication Technology, 2007. ICICT’07. International Conference on, pages 82–86. IEEE Biswas, Humayun Kabir & Hasan, Md Maruf. (2007). Using publications and domain knowledge to build research profiles: An application in automatic reviewer assignment. In Information and Communication Technology, 2007. ICICT’07. International Conference on, pages 82–86. IEEE
Zurück zum Zitat Buckley, Chris, & Voorhees, Ellen M. (2004). Retrieval evaluation with incomplete information. In Proceedings of the 27th annual International ACM SIGIR Conference on research and development in information retrieval, pages 25–32. ACM Buckley, Chris, & Voorhees, Ellen M. (2004). Retrieval evaluation with incomplete information. In Proceedings of the 27th annual International ACM SIGIR Conference on research and development in information retrieval, pages 25–32. ACM
Zurück zum Zitat Büttcher, Stefan, Clarke, Charles LA, & Gordon V Cormack. (2016). Information retrieval: Implementing and evaluating search engines. Mit Press. Büttcher, Stefan, Clarke, Charles LA, & Gordon V Cormack. (2016). Information retrieval: Implementing and evaluating search engines. Mit Press.
Zurück zum Zitat Charlin, Laurent, & Zemel, Richard. (2013). The toronto paper matching system: An automated paper-reviewer assignment system (p. 28). JMLR: W&CP. Charlin, Laurent, & Zemel, Richard. (2013). The toronto paper matching system: An automated paper-reviewer assignment system (p. 28). JMLR: W&CP.
Zurück zum Zitat Charlin, Laurent, Zemel, Richard S., & Boutilier, Craig. (2012). A framework for optimizing paper matching. arXiv preprintarXiv:1202.3706 Charlin, Laurent, Zemel, Richard S., & Boutilier, Craig. (2012). A framework for optimizing paper matching. arXiv preprintarXiv:​1202.​3706
Zurück zum Zitat Di Mauro, Nicola, Basile, Teresa MA, Ferilli, Stefano. (2005). Grape: An expert review assignment component for scientific conference management systems. In International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, pages 789–798. Springer Di Mauro, Nicola, Basile, Teresa MA, Ferilli, Stefano. (2005). Grape: An expert review assignment component for scientific conference management systems. In International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, pages 789–798. Springer
Zurück zum Zitat Dumais, Susan T., & Nielsen, Jakob. (1992). Automating the assignment of submitted manuscripts to reviewers. In Proceedings of the 15th Annual International ACM SIGIR Conference on Research and development in information retrieval, pages 233–244. ACM Dumais, Susan T., & Nielsen, Jakob. (1992). Automating the assignment of submitted manuscripts to reviewers. In Proceedings of the 15th Annual International ACM SIGIR Conference on Research and development in information retrieval, pages 233–244. ACM
Zurück zum Zitat Dung, Nguyen Dinh, Cong, Nguyen Huu, & Anh, Nguyen Tuan. (2017). Algorithm of dynamic programming for paper-reviewer assignment problem. IRJET, 04(11) Dung, Nguyen Dinh, Cong, Nguyen Huu, & Anh, Nguyen Tuan. (2017). Algorithm of dynamic programming for paper-reviewer assignment problem. IRJET, 04(11)
Zurück zum Zitat Ferilli, Stefano, Di Mauro, Nicola, Maria Altomare Basile, Teresa, Esposito, Floriana, & Biba, Marenglen. (2006). Automatic topics identification for reviewer assignment. In International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, pages 721–730. Springer Ferilli, Stefano, Di Mauro, Nicola, Maria Altomare Basile, Teresa, Esposito, Floriana, & Biba, Marenglen. (2006). Automatic topics identification for reviewer assignment. In International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, pages 721–730. Springer
Zurück zum Zitat Flach, Peter A., Spiegler, Sebastian, Golénia, Bruno, Price, Simon, Guiver, John, Herbrich, Ralf, et al. (2010). Novel tools to streamline the conference review process: Experiences from sigkdd’09. ACM SIGKDD Explorations Newsletter, 11(2), 63–67.CrossRef Flach, Peter A., Spiegler, Sebastian, Golénia, Bruno, Price, Simon, Guiver, John, Herbrich, Ralf, et al. (2010). Novel tools to streamline the conference review process: Experiences from sigkdd’09. ACM SIGKDD Explorations Newsletter, 11(2), 63–67.CrossRef
Zurück zum Zitat Goldsmith, Judy, & Sloan, Robert H. (2007). The ai conference paper assignment problem (pp. 53–57). Vancouver. In Proc: AAAI Workshop on Preference Handling for Artificial Intelligence. Goldsmith, Judy, & Sloan, Robert H. (2007). The ai conference paper assignment problem (pp. 53–57). Vancouver. In Proc: AAAI Workshop on Preference Handling for Artificial Intelligence.
Zurück zum Zitat Hettich, Seth, & Pazzani, Michael J. (2006). Mining for proposal reviewers: lessons learned at the national science foundation. In Proceedings of the 12th ACM SIGKDD International Conference on Knowledge discovery and data mining, pages 862–871. ACM Hettich, Seth, & Pazzani, Michael J. (2006). Mining for proposal reviewers: lessons learned at the national science foundation. In Proceedings of the 12th ACM SIGKDD International Conference on Knowledge discovery and data mining, pages 862–871. ACM
Zurück zum Zitat Hoang, Dinh Tuye, Nguyen, Ngoc Thanh, & Hwang, Dosam. (2019). Decision support system for assignment of conference papers to reviewers. In International Conference on Computational Collective Intelligence, pages 441–450. Springer Hoang, Dinh Tuye, Nguyen, Ngoc Thanh, & Hwang, Dosam. (2019). Decision support system for assignment of conference papers to reviewers. In International Conference on Computational Collective Intelligence, pages 441–450. Springer
Zurück zum Zitat Karimzadehgan, Maryam, & Zhai, ChengXiang. (2009). Constrained multi-aspect expertise matching for committee review assignment. In Proceedings of the 18th ACM conference on Information and knowledge management, pages 1697–1700. ACM Karimzadehgan, Maryam, & Zhai, ChengXiang. (2009). Constrained multi-aspect expertise matching for committee review assignment. In Proceedings of the 18th ACM conference on Information and knowledge management, pages 1697–1700. ACM
Zurück zum Zitat Karimzadehgan, Maryam, & Zhai, ChengXiang. (2012). Integer linear programming for constrained multi-aspect committee review assignment. Information Processing and Management, 48(4), 725–740.CrossRef Karimzadehgan, Maryam, & Zhai, ChengXiang. (2012). Integer linear programming for constrained multi-aspect committee review assignment. Information Processing and Management, 48(4), 725–740.CrossRef
Zurück zum Zitat Karimzadehgan, Maryam, Zhai, ChengXiang, & Belford, Geneva. (2008). Multi-aspect expertise matching for review assignment. In Proceedings of the 17th ACM conference on Information and knowledge management, pages 1113–1122. ACM Karimzadehgan, Maryam, Zhai, ChengXiang, & Belford, Geneva. (2008). Multi-aspect expertise matching for review assignment. In Proceedings of the 17th ACM conference on Information and knowledge management, pages 1113–1122. ACM
Zurück zum Zitat Kim, Jungil, & Lee, Eunjoo. (2018). Understanding review expertise of developers: A reviewer recommendation approach based on latent dirichlet allocation. Symmetry, 10(4), 114.MathSciNetCrossRef Kim, Jungil, & Lee, Eunjoo. (2018). Understanding review expertise of developers: A reviewer recommendation approach based on latent dirichlet allocation. Symmetry, 10(4), 114.MathSciNetCrossRef
Zurück zum Zitat Kou, Ngai Meng, Hou, U Leong, Mamoulis, Nikos, Gong, Zhiguo. (2015a). Weighted coverage based reviewer assignment. In Proceedings of the 2015 ACM SIGMOD International Conference on management of data, pages 2031–2046. ACM Kou, Ngai Meng, Hou, U Leong, Mamoulis, Nikos, Gong, Zhiguo. (2015a). Weighted coverage based reviewer assignment. In Proceedings of the 2015 ACM SIGMOD International Conference on management of data, pages 2031–2046. ACM
Zurück zum Zitat Kou, Ngai Meng, Mamoulis, Nikos, Li, Yuhong, Zhiguo Gong, Ye Li (2015b) et al. A topic-based reviewer assignment system. Proceedings of the VLDB Endowment, 8(12): 1852–1855 Kou, Ngai Meng, Mamoulis, Nikos, Li, Yuhong, Zhiguo Gong, Ye Li (2015b) et al. A topic-based reviewer assignment system. Proceedings of the VLDB Endowment, 8(12): 1852–1855
Zurück zum Zitat Kusner, Matt, Sun, Yu, Kolkin, Nicholas, & Weinberger, Kilian. (2015). From word embeddings to document distances. In International Conference on Machine Learning, pages 957–966 Kusner, Matt, Sun, Yu, Kolkin, Nicholas, & Weinberger, Kilian. (2015). From word embeddings to document distances. In International Conference on Machine Learning, pages 957–966
Zurück zum Zitat Li, Baochun, & Hou, Y Thomas. (2016). The new automated iEEE infocom review assignment system. IEEE Network, 30(5), 18–24.CrossRef Li, Baochun, & Hou, Y Thomas. (2016). The new automated iEEE infocom review assignment system. IEEE Network, 30(5), 18–24.CrossRef
Zurück zum Zitat Li, Xinlian, & Watanabe, Toyohide. (2013). Automatic paper-to-reviewer assignment, based on the matching degree of the reviewers. Procedia Computer Science, 22, 633–642.CrossRef Li, Xinlian, & Watanabe, Toyohide. (2013). Automatic paper-to-reviewer assignment, based on the matching degree of the reviewers. Procedia Computer Science, 22, 633–642.CrossRef
Zurück zum Zitat Lian, Jing Wu. (2018). Nicholas Mattei, Renee Noble, and Toby Walsh. The Conference paper assignment problem: Using order weighted averages to assign indivisible goods. Lian, Jing Wu. (2018). Nicholas Mattei, Renee Noble, and Toby Walsh. The Conference paper assignment problem: Using order weighted averages to assign indivisible goods.
Zurück zum Zitat Liu, Ou., Wang, Jun, Ma, Jian, & Sun, Yonghong. (2016). An intelligent decision support approach for reviewer assignment in r&d project selection. Computers in Industry, 76, 1–10.CrossRef Liu, Ou., Wang, Jun, Ma, Jian, & Sun, Yonghong. (2016). An intelligent decision support approach for reviewer assignment in r&d project selection. Computers in Industry, 76, 1–10.CrossRef
Zurück zum Zitat Long, Cheng, Wong, Raymond Chi-Wing, Peng, Yu, & Ye, Liangliang. (2013). On good and fair paper-reviewer assignment. In Data Mining (ICDM), 2013 IEEE 13th International Conference on, pages 1145–1150. IEEE Long, Cheng, Wong, Raymond Chi-Wing, Peng, Yu, & Ye, Liangliang. (2013). On good and fair paper-reviewer assignment. In Data Mining (ICDM), 2013 IEEE 13th International Conference on, pages 1145–1150. IEEE
Zurück zum Zitat McGlinchey, Noel, Hunter, Tom, Bromley, Jack, Fisher, Ruth, Debiec-Waszak, Anna, & Gaston, Thomas. (2019). Do journal administrators solve the reviewer assignment problem as well as editors? consideration of reviewer rigour and timeliness. Learned Publishing, 32(1), 37–46. (ISSN 0953-1513.). McGlinchey, Noel, Hunter, Tom, Bromley, Jack, Fisher, Ruth, Debiec-Waszak, Anna, & Gaston, Thomas. (2019). Do journal administrators solve the reviewer assignment problem as well as editors? consideration of reviewer rigour and timeliness. Learned Publishing, 32(1), 37–46. (ISSN 0953-1513.).
Zurück zum Zitat Mimno, David, McCallum, Andrew. (2007). Expertise modeling for matching papers with reviewers. In Proceedings of the 13th ACM SIGKDD International Conference on Knowledge discovery and data mining, pages 500–509. ACM Mimno, David, McCallum, Andrew. (2007). Expertise modeling for matching papers with reviewers. In Proceedings of the 13th ACM SIGKDD International Conference on Knowledge discovery and data mining, pages 500–509. ACM
Zurück zum Zitat Misale, Mohini, & Vanwari, Pankaj. (2017). A survey on recommendation system for technical paper reviewer assignment. In Electronics, Communication and Aerospace Technology (ICECA), 2017 International conference of, volume 2, pages 329–331. IEEE Misale, Mohini, & Vanwari, Pankaj. (2017). A survey on recommendation system for technical paper reviewer assignment. In Electronics, Communication and Aerospace Technology (ICECA), 2017 International conference of, volume 2, pages 329–331. IEEE
Zurück zum Zitat O’Dell, Regina, Wattenhofer, Mirjam, & Wattenhofer, Roger. (2005). The paper assignment problem (p. 491). Department of Computer Science: Technical report/Swiss Federal Institute of Technology Zurich. O’Dell, Regina, Wattenhofer, Mirjam, & Wattenhofer, Roger. (2005). The paper assignment problem (p. 491). Department of Computer Science: Technical report/Swiss Federal Institute of Technology Zurich.
Zurück zum Zitat Ogunleye, O., Ifebanjo, T., Abiodun, T., & Adebiyi, AA. (2017). Proposed framework for a paper-reviewer assignment system using word2vec Ogunleye, O., Ifebanjo, T., Abiodun, T., & Adebiyi, AA. (2017). Proposed framework for a paper-reviewer assignment system using word2vec
Zurück zum Zitat Peng, Hongwei, Hu, Haojie, Wang, Keqiang, & Wang, Xiaoling. (2017). Time-aware and topic-based reviewer assignment. In International Conference on Database Systems for Advanced Applications, pages 145–157. Springer Peng, Hongwei, Hu, Haojie, Wang, Keqiang, & Wang, Xiaoling. (2017). Time-aware and topic-based reviewer assignment. In International Conference on Database Systems for Advanced Applications, pages 145–157. Springer
Zurück zum Zitat Price, Simon, & Flach, Peter A. (2017). Computational support for academic peer review: A perspective from artificial intelligence. Communications of the ACM, 60(3), 70–79.CrossRef Price, Simon, & Flach, Peter A. (2017). Computational support for academic peer review: A perspective from artificial intelligence. Communications of the ACM, 60(3), 70–79.CrossRef
Zurück zum Zitat Protasiewicz, Jarosław. (2014). A support system for selection of reviewers. In Systems, Man and Cybernetics (SMC), 2014 IEEE International Conference on, pages 3062–3065. IEEE Protasiewicz, Jarosław. (2014). A support system for selection of reviewers. In Systems, Man and Cybernetics (SMC), 2014 IEEE International Conference on, pages 3062–3065. IEEE
Zurück zum Zitat Protasiewicz, Jaroslaw, Pedrycz, Witold, Kozlowski, Marek, Dadas, Slawomir, Stanislawek, Tomasz, Kopacz, Agata, & Galezewska, Malgorzata. (2016). A recommender system of reviewers and experts in reviewing problems. Knowledge-Based Systems, 106, 164–178.CrossRef Protasiewicz, Jaroslaw, Pedrycz, Witold, Kozlowski, Marek, Dadas, Slawomir, Stanislawek, Tomasz, Kopacz, Agata, & Galezewska, Malgorzata. (2016). A recommender system of reviewers and experts in reviewing problems. Knowledge-Based Systems, 106, 164–178.CrossRef
Zurück zum Zitat Rigaux, Philippe. (2004). An iterative rating method: application to web-based conference management. In Proceedings of the 2004 ACM symposium on Applied computing, pages 1682–1687. ACM Rigaux, Philippe. (2004). An iterative rating method: application to web-based conference management. In Proceedings of the 2004 ACM symposium on Applied computing, pages 1682–1687. ACM
Zurück zum Zitat Shon, Ho Sun, Han, Sang Hun, Kim, Kyung Ah, Cha, Eun Jong, & Ryu, Keun Ho. (2017). Proposal reviewer recommendation system based on big data for a national research management institute. Journal of Information Science, 43(2), 147–158.CrossRef Shon, Ho Sun, Han, Sang Hun, Kim, Kyung Ah, Cha, Eun Jong, & Ryu, Keun Ho. (2017). Proposal reviewer recommendation system based on big data for a national research management institute. Journal of Information Science, 43(2), 147–158.CrossRef
Zurück zum Zitat Sidiropoulos, Nicholas D., & Tsakonas, Efthymios. (2015). Signal processing and optimization tools for conference review and session assignment. IEEE Signal Processing Magazine, 32(3), 141–155.CrossRef Sidiropoulos, Nicholas D., & Tsakonas, Efthymios. (2015). Signal processing and optimization tools for conference review and session assignment. IEEE Signal Processing Magazine, 32(3), 141–155.CrossRef
Zurück zum Zitat Smucker, Mark D., Allan, James, & Carterette, Ben. (2007). A comparison of statistical significance tests for information retrieval evaluation. In Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, pages 623–632 Smucker, Mark D., Allan, James, & Carterette, Ben. (2007). A comparison of statistical significance tests for information retrieval evaluation. In Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, pages 623–632
Zurück zum Zitat Fair and accurate reviewer assignment in peer review. (2019). Ivan Stelmakh, Nihar B Shah, and Aarti Singh. Peerreview4all. Algorithmic Learning Theory, 98, 827–855. Fair and accurate reviewer assignment in peer review. (2019). Ivan Stelmakh, Nihar B Shah, and Aarti Singh. Peerreview4all. Algorithmic Learning Theory, 98, 827–855.
Zurück zum Zitat Tang, Wenbin, Tang, Jie, Tan, Chenhao. (2010). Expertise matching via constraint-based optimization. In Web intelligence and intelligent agent technology (wi-iat), 2010 IEEE/wic/acm International Conference on, volume 1, pages 34–41. IEEE Tang, Wenbin, Tang, Jie, Tan, Chenhao. (2010). Expertise matching via constraint-based optimization. In Web intelligence and intelligent agent technology (wi-iat), 2010 IEEE/wic/acm International Conference on, volume 1, pages 34–41. IEEE
Zurück zum Zitat Tang, Wenbin, Tang, Jie, Lei, Tao, Tan, Chenhao, Gao, Bo., & Li, Tian. (2012). On optimization of expertise matching with various constraints. Neurocomputing, 76(1), 71–83.CrossRef Tang, Wenbin, Tang, Jie, Lei, Tao, Tan, Chenhao, Gao, Bo., & Li, Tian. (2012). On optimization of expertise matching with various constraints. Neurocomputing, 76(1), 71–83.CrossRef
Zurück zum Zitat Tang, Xijin, & Zhang, Zhengwen. (2008). Paper review assignment based on human-knowledge network. In Systems, Man and Cybernetics, 2008. SMC 2008. IEEE International Conference on, pages 102–107. IEEE Tang, Xijin, & Zhang, Zhengwen. (2008). Paper review assignment based on human-knowledge network. In Systems, Man and Cybernetics, 2008. SMC 2008. IEEE International Conference on, pages 102–107. IEEE
Zurück zum Zitat Tayal, Devendra Kumar, Saxena, P. C., Sharma, Ankita, Khanna, Garima, & Gupta, Shubhangi. (2014). New method for solving reviewer assignment problem using type-2 fuzzy sets and fuzzy functions. Applied Intelligence, 40(1), 54–73.CrossRef Tayal, Devendra Kumar, Saxena, P. C., Sharma, Ankita, Khanna, Garima, & Gupta, Shubhangi. (2014). New method for solving reviewer assignment problem using type-2 fuzzy sets and fuzzy functions. Applied Intelligence, 40(1), 54–73.CrossRef
Zurück zum Zitat Wang, Fan, Chen, Ben, Miao, Zhaowei. (2008). A survey on reviewer assignment problem. In International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, pages 718–727. Springer Wang, Fan, Chen, Ben, Miao, Zhaowei. (2008). A survey on reviewer assignment problem. In International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, pages 718–727. Springer
Zurück zum Zitat Wang, Fan, Zhou, Shaorui, & Shi, Ning. (2013). Group-to-group reviewer assignment problem. Computers and Operations Research, 40(5), 1351–1362.MathSciNetCrossRef Wang, Fan, Zhou, Shaorui, & Shi, Ning. (2013). Group-to-group reviewer assignment problem. Computers and Operations Research, 40(5), 1351–1362.MathSciNetCrossRef
Zurück zum Zitat Xu, Yichong, Zhao, Han, Shi, Xiaofei, & Shah, Nihar B. (2019). On strategyproof Conference peer review. pages 616–622 Xu, Yichong, Zhao, Han, Shi, Xiaofei, & Shah, Nihar B. (2019). On strategyproof Conference peer review. pages 616–622
Zurück zum Zitat Yarowsky, David, & Florian, Radu. (1999). Taking the load off the conference chairs-towards a digital paper-routing assistant. In 1999 Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora Yarowsky, David, & Florian, Radu. (1999). Taking the load off the conference chairs-towards a digital paper-routing assistant. In 1999 Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora
Zurück zum Zitat Yeşilçimen, Ali, & Yıldırım, E Alper. (2019). An alternative polynomial-sized formulation and an optimization based heuristic for the reviewer assignment problem. European Journal of Operational Research, 276(2), 436–450.MathSciNetCrossRef Yeşilçimen, Ali, & Yıldırım, E Alper. (2019). An alternative polynomial-sized formulation and an optimization based heuristic for the reviewer assignment problem. European Journal of Operational Research, 276(2), 436–450.MathSciNetCrossRef
Zurück zum Zitat Zhang, Dong, Zhao, Shu, Duan, Zhen, Chen, Jie, Zhang, Yanping, & Tang, Jie. (2020a). A multi-label classification method using a hierarchical and transparent representation for paper-reviewer recommendation. ACM Transactions on Information Systems, 38(1), 1–20. (ISSN 1046-8188.). Zhang, Dong, Zhao, Shu, Duan, Zhen, Chen, Jie, Zhang, Yanping, & Tang, Jie. (2020a). A multi-label classification method using a hierarchical and transparent representation for paper-reviewer recommendation. ACM Transactions on Information Systems, 38(1), 1–20. (ISSN 1046-8188.).
Zurück zum Zitat Zhang, Dong, Zhao, Shu, Duan, Zhen, Chen, Jie, Zhang, Yanping, & Tang, Jie. (2020b). A multi-label classification method using a hierarchical and transparent representation for paper-reviewer recommendation. ACM Transactions on Information Systems (TOIS), 38(1), 1–20. Zhang, Dong, Zhao, Shu, Duan, Zhen, Chen, Jie, Zhang, Yanping, & Tang, Jie. (2020b). A multi-label classification method using a hierarchical and transparent representation for paper-reviewer recommendation. ACM Transactions on Information Systems (TOIS), 38(1), 1–20.
Zurück zum Zitat Zhao, Shu, Zhang, Dong, Duan, Zhen, Chen, Jie, Zhang, Yan-ping, & Tang, Jie. (2018). A novel classification method for paper-reviewer recommendation. Scientometrics, pages 1–21 Zhao, Shu, Zhang, Dong, Duan, Zhen, Chen, Jie, Zhang, Yan-ping, & Tang, Jie. (2018). A novel classification method for paper-reviewer recommendation. Scientometrics, pages 1–21
Metadaten
Titel
Improved reviewer assignment based on both word and semantic features
verfasst von
Shicheng Tan
Zhen Duan
Shu Zhao
Jie Chen
Yanping Zhang
Publikationsdatum
02.04.2021
Verlag
Springer Netherlands
Erschienen in
Discover Computing / Ausgabe 3/2021
Print ISSN: 2948-2984
Elektronische ISSN: 2948-2992
DOI
https://doi.org/10.1007/s10791-021-09390-8

Premium Partner