Skip to main content
Top
Published in: Health and Technology 5/2019

02-07-2019 | Original Paper

The evaluation of users’ satisfaction with the Social Security Electronic System in Iran

Authors: Reza Khajouei, Fatemeh Farahani

Published in: Health and Technology | Issue 5/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Assessing users’ satisfaction with the user interface of Healthcare Information System in order to determine their acceptance rate should be highlighted, especially at the early stages of its implementation. This study aimed to evaluate the users’ satisfaction with Social Security Electronic System (SSES), as a widely used HIS in Iran. The population of this study composed of 327 users among whom 176 were randomly selected. An adapted version of Computer System Usability Questionnaire (CSUQ) was used for collecting data. Data were analyzed using t-test, ANOVA, Spearman, Man Whitney U, and Kruskal-Wallis. In general, 140 subjects answered the questionnaire. The users’ mean scores of satisfaction with different aspects of usability and their overall satisfaction were 56.00 ± 13.00 and 3.01 ± 1.15, respectively, indicating a medium satisfaction. Overall satisfaction and satisfaction with different aspects of usability had no significant relationship with gender, age, education degree, and working experience with computers (p > 0.05). No significant relationship was observed between overall satisfaction and working experience with SSES (p > 0.05). However, the users’ satisfaction with different aspects of usability was significantly related to experience with HISs and SSES (p < 0.05). In addition, the overall satisfaction was significantly related to experience with HISs (p < 0.05). Based on the results, the users were relatively satisfied with the system. Thus, a user centered design is recommended to improve satisfaction by addressing several modifications such as providing an easier documentation process, using lower keystrockes and fewer screens, displaying appropriate messages, providing pop-ups, guiding the users, correcting the errors, and adding search functionalities.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Banet GA, et al. Effects of implementing computerized practitioner order entry and nursing documentation on nursing workflow in an emergency department. JHIM. 2006;20(2):45. Banet GA, et al. Effects of implementing computerized practitioner order entry and nursing documentation on nursing workflow in an emergency department. JHIM. 2006;20(2):45.
2.
go back to reference Horsky J, et al. A framework for analyzing the cognitive complexity of computer-assisted clinical ordering. J Biomed Inform. 2003;36(1):4–22.CrossRef Horsky J, et al. A framework for analyzing the cognitive complexity of computer-assisted clinical ordering. J Biomed Inform. 2003;36(1):4–22.CrossRef
3.
go back to reference Horsky J, Kuperman GJ, Patel VL. Comprehensive analysis of a medication dosing error related to CPOE. J Am Med Inform Assoc. 2005;12(4):377–82.CrossRef Horsky J, Kuperman GJ, Patel VL. Comprehensive analysis of a medication dosing error related to CPOE. J Am Med Inform Assoc. 2005;12(4):377–82.CrossRef
4.
go back to reference Bevan N, Carter J, Harker S. ISO 9241-11 revised: What have we learnt about usability since 1998?. In: International Conference on Human-Computer Interaction. Springer; 2015. Bevan N, Carter J, Harker S. ISO 9241-11 revised: What have we learnt about usability since 1998?. In: International Conference on Human-Computer Interaction. Springer; 2015.
5.
go back to reference Zhang J, Walji MF. TURF: toward a unified framework of EHR usability. J Biomed Inform. 2011;44(6):1056–67.CrossRef Zhang J, Walji MF. TURF: toward a unified framework of EHR usability. J Biomed Inform. 2011;44(6):1056–67.CrossRef
6.
go back to reference Walji MF, et al. Are three methods better than one? A comparative assessment of usability evaluation methods in an EHR. Int J Med Inform. 2014;83(5):361–7.CrossRef Walji MF, et al. Are three methods better than one? A comparative assessment of usability evaluation methods in an EHR. Int J Med Inform. 2014;83(5):361–7.CrossRef
7.
go back to reference Bates DW, et al. Reducing the frequency of errors in medicine using information technology. J Am Med Inform Assoc. 2001;8(4):299–308.CrossRef Bates DW, et al. Reducing the frequency of errors in medicine using information technology. J Am Med Inform Assoc. 2001;8(4):299–308.CrossRef
8.
go back to reference Han YY, et al. Unexpected increased mortality after implementation of a commercially sold computerized physician order entry system. Pediatrics. 2005;116(6):1506–12.CrossRef Han YY, et al. Unexpected increased mortality after implementation of a commercially sold computerized physician order entry system. Pediatrics. 2005;116(6):1506–12.CrossRef
9.
go back to reference Ives B, Olson MH, Baroudi JJ. The measurement of user information satisfaction. Commun ACM. 1983;26(10):785–93.CrossRef Ives B, Olson MH, Baroudi JJ. The measurement of user information satisfaction. Commun ACM. 1983;26(10):785–93.CrossRef
10.
go back to reference Chin WW, Lee MK. A proposed model and measurement instrument for the formation of IS satisfaction: the case of end-user computing satisfaction. In: Proceedings of the twenty first international conference on Information systems. Association for Information Systems; 2000. Chin WW, Lee MK. A proposed model and measurement instrument for the formation of IS satisfaction: the case of end-user computing satisfaction. In: Proceedings of the twenty first international conference on Information systems. Association for Information Systems; 2000.
11.
go back to reference Lucas HC, Ginzberg MJ, Schultz RL. Information systems implementation: testing a structural model. Norwood: Ablex Publishing Corp; 1990. pp. 43-39. Lucas HC, Ginzberg MJ, Schultz RL. Information systems implementation: testing a structural model. Norwood: Ablex Publishing Corp; 1990. pp. 43-39.
12.
go back to reference Yusof MM, et al. An evaluation framework for Health Information Systems: human, organization and technology-fit factors (HOT-fit). Int J Med Inform. 2008;77(6):386–98.CrossRef Yusof MM, et al. An evaluation framework for Health Information Systems: human, organization and technology-fit factors (HOT-fit). Int J Med Inform. 2008;77(6):386–98.CrossRef
13.
go back to reference Delone WH, McLean ER. The DeLone and McLean model of information systems success: a ten-year update. J Manag Inf Syst. 2003;19(4):9–30.CrossRef Delone WH, McLean ER. The DeLone and McLean model of information systems success: a ten-year update. J Manag Inf Syst. 2003;19(4):9–30.CrossRef
14.
go back to reference Mahmood MA, et al. Variables affecting information technology end-user satisfaction: a meta-analysis of the empirical literature. Int J Hum Comput Stud. 2000;52(4):751–71.CrossRef Mahmood MA, et al. Variables affecting information technology end-user satisfaction: a meta-analysis of the empirical literature. Int J Hum Comput Stud. 2000;52(4):751–71.CrossRef
15.
go back to reference Scheepers R, Scheepers H, Ngwenyama OK. Contextual influences on user satisfaction with mobile computing: findings from two healthcare organizations. Eur J Inf Syst. 2006;15(3):261–8.CrossRef Scheepers R, Scheepers H, Ngwenyama OK. Contextual influences on user satisfaction with mobile computing: findings from two healthcare organizations. Eur J Inf Syst. 2006;15(3):261–8.CrossRef
16.
go back to reference Gatian AW. Is user satisfaction a valid measure of system effectiveness? Inf Manag. 1994;26(3):119–31.CrossRef Gatian AW. Is user satisfaction a valid measure of system effectiveness? Inf Manag. 1994;26(3):119–31.CrossRef
17.
go back to reference Suh K, Kim S, Lee J. End-user's disconfirmed expectations and the success of information systems. Inf Resour Manag J. 1994;7(4):30.CrossRef Suh K, Kim S, Lee J. End-user's disconfirmed expectations and the success of information systems. Inf Resour Manag J. 1994;7(4):30.CrossRef
18.
go back to reference Tse DK, Wilton PC. Models of consumer satisfaction formation: an extension. J Mark Res. 1988:204–12.CrossRef Tse DK, Wilton PC. Models of consumer satisfaction formation: an extension. J Mark Res. 1988:204–12.CrossRef
19.
go back to reference Beuscart-Zéphir MC, et al. Impact of CPOE on doctor–nurse cooperation for the medication ordering and administration process. Int J Med Inform. 2005;74(7):629–41.CrossRef Beuscart-Zéphir MC, et al. Impact of CPOE on doctor–nurse cooperation for the medication ordering and administration process. Int J Med Inform. 2005;74(7):629–41.CrossRef
20.
go back to reference Khajouei R, de Jongh D, Jaspers MW. Usability evaluation of a computerized physician order entry for medication ordering. In: MIE. 2009. Khajouei R, de Jongh D, Jaspers MW. Usability evaluation of a computerized physician order entry for medication ordering. In: MIE. 2009.
21.
go back to reference Khajouei R, Jaspers MW. The impact of CPOE medication systems' design aspects on usability, workflow and medication orders. Methods Inf Med. 2010;49(1):3.CrossRef Khajouei R, Jaspers MW. The impact of CPOE medication systems' design aspects on usability, workflow and medication orders. Methods Inf Med. 2010;49(1):3.CrossRef
22.
go back to reference Khajouei R, et al. Effect of predefined order sets and usability problems on efficiency of computerized medication ordering. Int J Med Inform. 2010;79(10):690–8.CrossRef Khajouei R, et al. Effect of predefined order sets and usability problems on efficiency of computerized medication ordering. Int J Med Inform. 2010;79(10):690–8.CrossRef
23.
go back to reference Khajouei R, Abbasi R. Evaluating nurses' satisfaction with two nursing information systems. CIN. 2017;35(6):307–14. Khajouei R, Abbasi R. Evaluating nurses' satisfaction with two nursing information systems. CIN. 2017;35(6):307–14.
24.
go back to reference Safdari R, et al. Comparing four softwares based on ISO 9241 part 10. J Med Syst. 2012;36(5):2787–93.CrossRef Safdari R, et al. Comparing four softwares based on ISO 9241 part 10. J Med Syst. 2012;36(5):2787–93.CrossRef
25.
go back to reference Alipour J, et al. Users view about hospital information system in children's hospital, Bandar Abbas, Iran. 2010. Alipour J, et al. Users view about hospital information system in children's hospital, Bandar Abbas, Iran. 2010.
26.
go back to reference Lee TT, et al. Factors affecting the use of nursing information systems in Taiwan. J Adv Nurs. 2005;50(2):170–8.CrossRef Lee TT, et al. Factors affecting the use of nursing information systems in Taiwan. J Adv Nurs. 2005;50(2):170–8.CrossRef
27.
go back to reference Marasovic C, et al. Attitudes of Australian nurses toward the implementation of a clinical information system. Comput Nurs. 1997;15(2):91–8. Marasovic C, et al. Attitudes of Australian nurses toward the implementation of a clinical information system. Comput Nurs. 1997;15(2):91–8.
28.
go back to reference Mazzoleni M, et al. Assessing users' satisfaction through perception of usefulness and ease of use in the daily interaction with a hospital information system. In: Proceedings of the AMIA Annual Fall Symposium. American Medical Informatics Association; 1996. Mazzoleni M, et al. Assessing users' satisfaction through perception of usefulness and ease of use in the daily interaction with a hospital information system. In: Proceedings of the AMIA Annual Fall Symposium. American Medical Informatics Association; 1996.
29.
go back to reference Palm J-M, et al. Determinants of user satisfaction with a Clinical Information System. In: AMIA Annual Symposium Proceedings. American Medical Informatics Association; 2006. Palm J-M, et al. Determinants of user satisfaction with a Clinical Information System. In: AMIA Annual Symposium Proceedings. American Medical Informatics Association; 2006.
30.
go back to reference Sittig DF, Kuperman GJ, Fiskio J. Evaluating physician satisfaction regarding user interactions with an electronic medical record system. In: Proceedings of the AMIA Symposium. American Medical Informatics Association; 1999. Sittig DF, Kuperman GJ, Fiskio J. Evaluating physician satisfaction regarding user interactions with an electronic medical record system. In: Proceedings of the AMIA Symposium. American Medical Informatics Association; 1999.
31.
go back to reference Sleutel M, Guinn M. As good as it gets? Going online with a clinical information system. Comput Nurs. 1999;17(4):181–5. Sleutel M, Guinn M. As good as it gets? Going online with a clinical information system. Comput Nurs. 1999;17(4):181–5.
32.
go back to reference Bahnassy A. Nurses’ satisfaction with the use of health information system (HIS) in a Saudi tertiary care medical center. IJARSSE. 2015;5(5):56–61. Bahnassy A. Nurses’ satisfaction with the use of health information system (HIS) in a Saudi tertiary care medical center. IJARSSE. 2015;5(5):56–61.
33.
go back to reference Khajouei R, et al. Clinicians satisfaction with CPOE ease of use and effect on clinicians’ workflow, efficiency and medication safety. Int J Med Inform. 2011;80(5):297–309.CrossRef Khajouei R, et al. Clinicians satisfaction with CPOE ease of use and effect on clinicians’ workflow, efficiency and medication safety. Int J Med Inform. 2011;80(5):297–309.CrossRef
34.
go back to reference Kim S-Y. Factors affecting the degree of satisfaction for nursing information system. Stud Health Technol Inform. 2005;122:523–6. Kim S-Y. Factors affecting the degree of satisfaction for nursing information system. Stud Health Technol Inform. 2005;122:523–6. 
35.
go back to reference Strudwick G, et al. A scoping review of research involving nurses and electronic health records in middle eastern countries. Int Arch Nurs Health Care. 2015;(1):012. Strudwick G, et al. A scoping review of research involving nurses and electronic health records in middle eastern countries. Int Arch Nurs Health Care. 2015;(1):012.
36.
go back to reference DeLone WH, McLean ER. Information systems success: the quest for the dependent variable. Inf Syst Res. 1992;3(1):60–95.CrossRef DeLone WH, McLean ER. Information systems success: the quest for the dependent variable. Inf Syst Res. 1992;3(1):60–95.CrossRef
37.
go back to reference Pai F-Y, Huang K-I. Applying the technology acceptance model to the introduction of healthcare information systems. Technol Forecast Soc Chang. 2011;78(4):650–60.CrossRef Pai F-Y, Huang K-I. Applying the technology acceptance model to the introduction of healthcare information systems. Technol Forecast Soc Chang. 2011;78(4):650–60.CrossRef
38.
go back to reference Yen P-Y. Health information technology usability evaluation: methods, models, and measures. Columbia University; 2010. Yen P-Y. Health information technology usability evaluation: methods, models, and measures. Columbia University; 2010.
39.
go back to reference Venkatesh V, Davis FD. A theoretical extension of the technology acceptance model: four longitudinal field studies. Manag Sci. 2000;46(2):186–204.CrossRef Venkatesh V, Davis FD. A theoretical extension of the technology acceptance model: four longitudinal field studies. Manag Sci. 2000;46(2):186–204.CrossRef
40.
go back to reference Rusli NM, Hassan S, Liau NE. Usability analysis of students information system in a public university. JETEAS. 2013;4(6):806–10. Rusli NM, Hassan S, Liau NE. Usability analysis of students information system in a public university. JETEAS. 2013;4(6):806–10.
41.
go back to reference Lee F, et al. Implementation of physician order entry: user satisfaction and self-reported usage patterns. J Am Med Inform Assoc. 1996;3(1):42–55.MathSciNetCrossRef Lee F, et al. Implementation of physician order entry: user satisfaction and self-reported usage patterns. J Am Med Inform Assoc. 1996;3(1):42–55.MathSciNetCrossRef
42.
go back to reference Gress TW, et al. Contrasting Views of Physicians and Nurses about an Inpatient Computer-based Provider Order-entry System. 1999. Gress TW, et al. Contrasting Views of Physicians and Nurses about an Inpatient Computer-based Provider Order-entry System. 1999.
43.
go back to reference Michel-Verkerke MB. Information quality of a nursing information system depends on the nurses: a combined quantitative and qualitative evaluation. Int J Med Inform. 2012;81(10):662–73.CrossRef Michel-Verkerke MB. Information quality of a nursing information system depends on the nurses: a combined quantitative and qualitative evaluation. Int J Med Inform. 2012;81(10):662–73.CrossRef
44.
go back to reference Davis SA, Bostrom RP. Training end users: an experimental investigation of the roles of the computer interface and training methods. MIS Q. 1993:61–85.CrossRef Davis SA, Bostrom RP. Training end users: an experimental investigation of the roles of the computer interface and training methods. MIS Q. 1993:61–85.CrossRef
45.
go back to reference Soliman KS, Mao E, Frolick MN. Measuring user satisfaction with data warehouses: an exploratory study. Inf Manag. 2000;37(3):103–10.CrossRef Soliman KS, Mao E, Frolick MN. Measuring user satisfaction with data warehouses: an exploratory study. Inf Manag. 2000;37(3):103–10.CrossRef
46.
go back to reference Quaddus M, Intrapairot A. Management policies and the diffusion of data warehouse: a case study using system dynamics-based decision support system. Decis Support Syst. 2001;31(2):223–40.CrossRef Quaddus M, Intrapairot A. Management policies and the diffusion of data warehouse: a case study using system dynamics-based decision support system. Decis Support Syst. 2001;31(2):223–40.CrossRef
47.
go back to reference Aggelidis VP, Chatzoglou PD. Hospital information systems: measuring end user computing satisfaction (EUCS). J Biomed Inform. 2012;45(3):566–79.CrossRef Aggelidis VP, Chatzoglou PD. Hospital information systems: measuring end user computing satisfaction (EUCS). J Biomed Inform. 2012;45(3):566–79.CrossRef
48.
go back to reference Park KS, Lim CH. A structured methodology for comparative evaluation of user interface designs using usability criteria and measures. Int J Ind Ergon. 1999;23(5):379–89.CrossRef Park KS, Lim CH. A structured methodology for comparative evaluation of user interface designs using usability criteria and measures. Int J Ind Ergon. 1999;23(5):379–89.CrossRef
49.
go back to reference Benbunan-Fich R. Using protocol analysis to evaluate the usability of a commercial web site. Inf Manag. 2001;39(2):151–63.CrossRef Benbunan-Fich R. Using protocol analysis to evaluate the usability of a commercial web site. Inf Manag. 2001;39(2):151–63.CrossRef
50.
go back to reference Lin JC-C, Lu H. Towards an understanding of the behavioural intention to use a web site. Int J Inf Manag. 2000;20(3):197–208.CrossRef Lin JC-C, Lu H. Towards an understanding of the behavioural intention to use a web site. Int J Inf Manag. 2000;20(3):197–208.CrossRef
51.
go back to reference Rushinek A, Rushinek SF. Accounting and billing software and user reactions: an interactive diagnostic audit trail. Inf Manag. 1985;9(1):9–20.CrossRef Rushinek A, Rushinek SF. Accounting and billing software and user reactions: an interactive diagnostic audit trail. Inf Manag. 1985;9(1):9–20.CrossRef
52.
go back to reference Shneiderman B. Designing the user interface: strategies for effective human-computer interaction. Pearson Education India; 2010. Shneiderman B. Designing the user interface: strategies for effective human-computer interaction. Pearson Education India; 2010.
53.
go back to reference Norman KL. Development of a Tool Measuring User Satisfaction of the Human-Computer Interface John P. Chin Virginia A. Diehl. Norman KL. Development of a Tool Measuring User Satisfaction of the Human-Computer Interface John P. Chin Virginia A. Diehl.
54.
go back to reference Ribière V, et al. Hospital information systems quality: a customer satisfaction assessment tool. in Systems Sciences, 1999. HICSS-32. Proceedings of the 32nd Annual Hawaii International Conference on. IEEE; 1999. Ribière V, et al. Hospital information systems quality: a customer satisfaction assessment tool. in Systems Sciences, 1999. HICSS-32. Proceedings of the 32nd Annual Hawaii International Conference on. IEEE; 1999.
55.
go back to reference Gelderman M. The relation between user satisfaction, usage of information systems and performance. Inf Manag. 1998;34(1):11–8.CrossRef Gelderman M. The relation between user satisfaction, usage of information systems and performance. Inf Manag. 1998;34(1):11–8.CrossRef
Metadata
Title
The evaluation of users’ satisfaction with the Social Security Electronic System in Iran
Authors
Reza Khajouei
Fatemeh Farahani
Publication date
02-07-2019
Publisher
Springer Berlin Heidelberg
Published in
Health and Technology / Issue 5/2019
Print ISSN: 2190-7188
Electronic ISSN: 2190-7196
DOI
https://doi.org/10.1007/s12553-019-00347-y

Other articles of this Issue 5/2019

Health and Technology 5/2019 Go to the issue

Premium Partner