Skip to main content
Top
Published in: Software and Systems Modeling 6/2021

04-01-2021 | Special Section Paper

Testing cockpit display systems of aircraft using a model-based approach

Authors: Hassan Sartaj, Muhammad Zohaib Iqbal, Muhammad Uzair Khan

Published in: Software and Systems Modeling | Issue 6/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Avionics are highly critical systems that require extensive testing to comply with international safety standards. Cockpit display systems (CDS) are a mandatory part of modern cockpits of both manned and unmanned aircraft. The information from various avionics components is displayed on CDS using a variety of flight instruments. An important part of testing avionics systems is to evaluate whether the displayed information on the CDS is correct or not. A common industrial practice is to manually test CDS, which is time-consuming, labor-intensive, and error-prone. In this paper, we propose a model-based approach to automate the CDS testing of aircraft. The proposed approach tests the CDS at two levels: (i) at the system level to verify that the CDS are working correctly and (ii) at system integration level of CDS when these are integrated with various avionics components. As a part of our approach, we develop a UML profile to model various elements of the CDS. The models are then used to support the automated testing process. We evaluate our approach on two industrial case studies, the first case study represents a primary flight display (PFD) of an aircraft and the second one is the CDS of the ground control station (GCS-CDS) of an unmanned aerial vehicle. The evaluation results show that three potential faults are identified in the PFD and four major faults are found in the GCS-CDS.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Alegroth, E., Nass, M., Olsson, H.H.: Jautomate: A tool for system-and acceptance-test automation. In: 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation, pp. 439–446. IEEE (2013) Alegroth, E., Nass, M., Olsson, H.H.: Jautomate: A tool for system-and acceptance-test automation. In: 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation, pp. 439–446. IEEE (2013)
2.
go back to reference Amalfitano, D., Fasolino, A.R., Tramontana, P., De Carmine, S., Memon, A.M.: Using GUI ripping for automated testing of android applications. In: Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering, pp. 258–261. ACM (2012) Amalfitano, D., Fasolino, A.R., Tramontana, P., De Carmine, S., Memon, A.M.: Using GUI ripping for automated testing of android applications. In: Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering, pp. 258–261. ACM (2012)
4.
go back to reference Antoniol, G., Briand, L.C., Di Penta, M., Labiche, Y.: A case study using the round-trip strategy for state-based class testing. In: 13th International Symposium on Software Reliability Engineering, 2002. Proceedings., p. 269. IEEE (2002) Antoniol, G., Briand, L.C., Di Penta, M., Labiche, Y.: A case study using the round-trip strategy for state-based class testing. In: 13th International Symposium on Software Reliability Engineering, 2002. Proceedings., p. 269. IEEE (2002)
5.
go back to reference ARP4754, S.: Certification considerations for highly-integrated or complex aircraft systems. SAE, Warrendale (1996) ARP4754, S.: Certification considerations for highly-integrated or complex aircraft systems. SAE, Warrendale (1996)
7.
go back to reference Baek, Y.M., Bae, D.H.: Automated model-based android GUI testing using multi-level GUI comparison criteria. In: Proceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering, pp. 238–249. ACM (2016) Baek, Y.M., Bae, D.H.: Automated model-based android GUI testing using multi-level GUI comparison criteria. In: Proceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering, pp. 238–249. ACM (2016)
8.
go back to reference Behnken, D., Salgado, R.: Automated testing of cockpit display visual aspects. AUTOTESTCON IEEE 1(1), 551–551 (1992) Behnken, D., Salgado, R.: Automated testing of cockpit display visual aspects. AUTOTESTCON IEEE 1(1), 551–551 (1992)
9.
go back to reference Berndt, J.: Jsbsim: An open source flight dynamics model in c++. In: AIAA Modeling and Simulation Technologies Conference and Exhibit, p. 4923 (2004) Berndt, J.: Jsbsim: An open source flight dynamics model in c++. In: AIAA Modeling and Simulation Technologies Conference and Exhibit, p. 4923 (2004)
10.
go back to reference Binder, R.: Testing Object-Oriented Systems: Models, Patterns, and Tools. Addison-Wesley Professional, Boston (2000) Binder, R.: Testing Object-Oriented Systems: Models, Patterns, and Tools. Addison-Wesley Professional, Boston (2000)
11.
go back to reference Bradski, G., Kaehler, A.: Opencv. Dr Dobb’s journal of software tools 3 (2000) Bradski, G., Kaehler, A.: Opencv. Dr Dobb’s journal of software tools 3 (2000)
12.
go back to reference Campos, J.C., Fayollas, C., Martinie, C., Navarre, D., Palanque, P., Pinto, M.: Systematic automation of scenario-based testing of user interfaces. In: Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, pp. 138–148. ACM (2016) Campos, J.C., Fayollas, C., Martinie, C., Navarre, D., Palanque, P., Pinto, M.: Systematic automation of scenario-based testing of user interfaces. In: Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems, pp. 138–148. ACM (2016)
13.
go back to reference Campos, J.C., Fayollas, C., Gonçalves, M., Martinie, C., Navarre, D., Palanque, P., Pinto, M.: A more intelligent test case generation approach through task models manipulation. Proc. ACM Hum. Comput. Interact. 1(1), 9 (2017) Campos, J.C., Fayollas, C., Gonçalves, M., Martinie, C., Navarre, D., Palanque, P., Pinto, M.: A more intelligent test case generation approach through task models manipulation. Proc. ACM Hum. Comput. Interact. 1(1), 9 (2017)
14.
go back to reference Catelani, M., Ciani, L., Venzi, M., Barile, G.: Environmental tests and optical measurements in the validation process of TFT-LCD for avionics applications. In: Metrology for Aerospace (MetroAeroSpace), 2015 IEEE, pp. 421–425. IEEE (2015) Catelani, M., Ciani, L., Venzi, M., Barile, G.: Environmental tests and optical measurements in the validation process of TFT-LCD for avionics applications. In: Metrology for Aerospace (MetroAeroSpace), 2015 IEEE, pp. 421–425. IEEE (2015)
15.
go back to reference Chang, T.H., Yeh, T., Miller, R.C.: Gui testing using computer vision. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1535–1544. ACM (2010) Chang, T.H., Yeh, T., Miller, R.C.: Gui testing using computer vision. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1535–1544. ACM (2010)
16.
go back to reference Choi, Y.M., Lim, D.J.: Automatic feasible transition path generation from UML state chart diagrams using grouping genetic algorithms. Inf. Softw. Technol. 94, 38–58 (2018)CrossRef Choi, Y.M., Lim, D.J.: Automatic feasible transition path generation from UML state chart diagrams using grouping genetic algorithms. Inf. Softw. Technol. 94, 38–58 (2018)CrossRef
17.
go back to reference Damilano, L., Guglieri, G., Quagliotti, F., Sale, I., Lunghi, A.: Ground control station embedded mission planning for UAS. J. Intell. Robot. Syst. 69(1–4), 241–256 (2013)CrossRef Damilano, L., Guglieri, G., Quagliotti, F., Sale, I., Lunghi, A.: Ground control station embedded mission planning for UAS. J. Intell. Robot. Syst. 69(1–4), 241–256 (2013)CrossRef
19.
go back to reference El-Far, I.K., Whittaker, J.A.: Model-based software testing. Encyclopedia of Software Engineering (2002) El-Far, I.K., Whittaker, J.A.: Model-based software testing. Encyclopedia of Software Engineering (2002)
20.
go back to reference Ferrell, T.K., Ferrell, U.D.: Rtca do-178c/eurocae ed-12c. In: Digital Avionics Handbook (2017) Ferrell, T.K., Ferrell, U.D.: Rtca do-178c/eurocae ed-12c. In: Digital Avionics Handbook (2017)
21.
go back to reference Garousi, V., Afzal, W., Caglar, A., Isik, I.B., Baydan, B., Caylak, S., Boyraz, A.Z., Yolacan, B., Herkiloglu, K.: Comparing automated visual GUI testing tools: an industrial case study. In: Proceedings of the 8th ACM SIGSOFT International Workshop on Automated Software Testing, pp. 21–28. ACM (2017) Garousi, V., Afzal, W., Caglar, A., Isik, I.B., Baydan, B., Caylak, S., Boyraz, A.Z., Yolacan, B., Herkiloglu, K.: Comparing automated visual GUI testing tools: an industrial case study. In: Proceedings of the 8th ACM SIGSOFT International Workshop on Automated Software Testing, pp. 21–28. ACM (2017)
22.
go back to reference Group, I., et al.: Ieee standard classification for software anomalies. IEEE Std 1044-2009 (Revision of IEEE Std 1044-1993) 1044(2), 1–23 (2010) Group, I., et al.: Ieee standard classification for software anomalies. IEEE Std 1044-2009 (Revision of IEEE Std 1044-1993) 1044(2), 1–23 (2010)
23.
go back to reference Guerra, M., Rhudy, M., Gu, Y., Seanor, B., Napolitano, M.: Mobile ground control station development for fault tolerant UAV research. In: AIAA Guidance, Navigation, and Control Conference, p. 4544 (2012) Guerra, M., Rhudy, M., Gu, Y., Seanor, B., Napolitano, M.: Mobile ground control station development for fault tolerant UAV research. In: AIAA Guidance, Navigation, and Control Conference, p. 4544 (2012)
24.
go back to reference Iftikhar, S., Iqbal, M.Z., Khan, M.U., Mahmood, W.: An automated model based testing approach for platform games. In: Model Driven Engineering Languages and Systems (MODELS), 2015 ACM/IEEE 18th International Conference on, pp. 426–435. IEEE (2015) Iftikhar, S., Iqbal, M.Z., Khan, M.U., Mahmood, W.: An automated model based testing approach for platform games. In: Model Driven Engineering Languages and Systems (MODELS), 2015 ACM/IEEE 18th International Conference on, pp. 426–435. IEEE (2015)
25.
go back to reference Iqbal, M.Z., Ali, S., Yue, T., Briand, L.: Applying UML/MARTE on industrial projects: challenges, experiences, and guidelines. Softw. Syst. Model. 14(4), 1367–1385 (2015)CrossRef Iqbal, M.Z., Ali, S., Yue, T., Briand, L.: Applying UML/MARTE on industrial projects: challenges, experiences, and guidelines. Softw. Syst. Model. 14(4), 1367–1385 (2015)CrossRef
26.
go back to reference Iqbal, M.Z., Sartaj, H., Khan, M.U., Haq, F.U., Qaisar, I.: A model-based testing approach for cockpit display systems of avionics. In: 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems (MODELS), pp. 67–77. IEEE (2019) Iqbal, M.Z., Sartaj, H., Khan, M.U., Haq, F.U., Qaisar, I.: A model-based testing approach for cockpit display systems of avionics. In: 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems (MODELS), pp. 67–77. IEEE (2019)
27.
go back to reference Kayayurt, B., Yayla, I., Yapici, A., Küçükoğuz, C.: Ground control station avionics software development in ANKA UAV. In: 2011 IEEE/AIAA 30th Digital Avionics Systems Conference, pp. 5B6–1. IEEE (2011) Kayayurt, B., Yayla, I., Yapici, A., Küçükoğuz, C.: Ground control station avionics software development in ANKA UAV. In: 2011 IEEE/AIAA 30th Digital Avionics Systems Conference, pp. 5B6–1. IEEE (2011)
28.
go back to reference Khan, M.U., Sartaj, H., Iqbal, M.Z., Usman, M., Arshad, N.: Aspectocl: using aspects to ease maintenance of evolving constraint specification. Empir. Softw. Eng. 24(4), 2674–2724 (2019)CrossRef Khan, M.U., Sartaj, H., Iqbal, M.Z., Usman, M., Arshad, N.: Aspectocl: using aspects to ease maintenance of evolving constraint specification. Empir. Softw. Eng. 24(4), 2674–2724 (2019)CrossRef
29.
go back to reference Lelli, V., Blouin, A., Baudry, B.: Classifying and qualifying GUI defects. In: 2015 IEEE 8th International Conference on Software Testing, Verification and Validation (ICST), pp. 1–10. IEEE (2015) Lelli, V., Blouin, A., Baudry, B.: Classifying and qualifying GUI defects. In: 2015 IEEE 8th International Conference on Software Testing, Verification and Validation (ICST), pp. 1–10. IEEE (2015)
30.
go back to reference Mor, N., Wolf, L.: Confidence prediction for lexicon-free OCR. In: 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 218–225. IEEE (2018) Mor, N., Wolf, L.: Confidence prediction for lexicon-free OCR. In: 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 218–225. IEEE (2018)
31.
go back to reference Nguyen, B.N., Robbins, B., Banerjee, I., Memon, A.: Guitar: an innovative tool for automated testing of GUI-driven software. Autom. Softw. Eng. 21(1), 65–105 (2014)CrossRef Nguyen, B.N., Robbins, B., Banerjee, I., Memon, A.: Guitar: an innovative tool for automated testing of GUI-driven software. Autom. Softw. Eng. 21(1), 65–105 (2014)CrossRef
34.
go back to reference Patel, C., Patel, A., Patel, D.: Optical character recognition by open source OCR tool tesseract: a case study. Int. J. Comput. Appl. 55(10), 50–56 (2012) Patel, C., Patel, A., Patel, D.: Optical character recognition by open source OCR tool tesseract: a case study. Int. J. Comput. Appl. 55(10), 50–56 (2012)
36.
go back to reference Salton, G., McGill, M.J.: Introduction to Modern Information, Retrieval. McGraw-Hill Inc, New York (1986)MATH Salton, G., McGill, M.J.: Introduction to Modern Information, Retrieval. McGraw-Hill Inc, New York (1986)MATH
37.
go back to reference Sartaj, H., Iqbal, M.Z., Jilani, A.A.A., Khan, M.U.: A search-based approach to generate mc/dc test data for OCL constraints. In: International Symposium on Search Based Software Engineering, pp. 105–120. Springer (2019) Sartaj, H., Iqbal, M.Z., Jilani, A.A.A., Khan, M.U.: A search-based approach to generate mc/dc test data for OCL constraints. In: International Symposium on Search Based Software Engineering, pp. 105–120. Springer (2019)
38.
go back to reference Sartaj, H., Iqbal, M.Z., Khan, M.U.: Cdst: A toolkit for testing cockpit display systems. In: 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST), pp. 436–441. IEEE (2020) Sartaj, H., Iqbal, M.Z., Khan, M.U.: Cdst: A toolkit for testing cockpit display systems. In: 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST), pp. 436–441. IEEE (2020)
39.
go back to reference Smith, R.: An overview of the tesseract OCR engine. In: Ninth International Conference on Document Analysis and Recognition, 2007. ICDAR 2007, vol. 2, pp. 629–633, IEEE (2007) Smith, R.: An overview of the tesseract OCR engine. In: Ninth International Conference on Document Analysis and Recognition, 2007. ICDAR 2007, vol. 2, pp. 629–633, IEEE (2007)
40.
go back to reference Smith, R., Antonova, D., Lee, D.S.: Adapting the tesseract open source OCR engine for multilingual OCR. In: Proceedings of the International Workshop on Multilingual OCR, p. 1. ACM (2009) Smith, R., Antonova, D., Lee, D.S.: Adapting the tesseract open source OCR engine for multilingual OCR. In: Proceedings of the International Workshop on Multilingual OCR, p. 1. ACM (2009)
41.
go back to reference Specification, A.: 661–3 Cockpit Display System Interfaces to User Systems. Aeronautical Radio Inc, Annapolis (2007) Specification, A.: 661–3 Cockpit Display System Interfaces to User Systems. Aeronautical Radio Inc, Annapolis (2007)
42.
go back to reference Ulbig, P., Müller, D., Torens, C., Insaurralde, C.C., Stripf, T., Durak, U.: Flight simulator-based verification for model-based avionics applications on multi-core targets. In: AIAA Scitech 2019 Forum, p. 1976 (2019) Ulbig, P., Müller, D., Torens, C., Insaurralde, C.C., Stripf, T., Durak, U.: Flight simulator-based verification for model-based avionics applications on multi-core targets. In: AIAA Scitech 2019 Forum, p. 1976 (2019)
43.
go back to reference Utting, M., Legeard, B.: Practical Model-Based Testing: A Tools Approach. Elsevier, Amsterdam (2010) Utting, M., Legeard, B.: Practical Model-Based Testing: A Tools Approach. Elsevier, Amsterdam (2010)
44.
go back to reference Wohlin, C., Runeson, P., Höst, M., Ohlsson, M.C., Regnell, B., Wesslén, A.: Experimentation in Software Engineering. Springer, Berlin (2012)CrossRef Wohlin, C., Runeson, P., Höst, M., Ohlsson, M.C., Regnell, B., Wesslén, A.: Experimentation in Software Engineering. Springer, Berlin (2012)CrossRef
45.
go back to reference Yang, W., Prasad, M.R., Xie, T.: A grey-box approach for automated GUI-model generation of mobile applications. In: International Conference on Fundamental Approaches to Software Engineering, pp 250–265. Springer (2013) Yang, W., Prasad, M.R., Xie, T.: A grey-box approach for automated GUI-model generation of mobile applications. In: International Conference on Fundamental Approaches to Software Engineering, pp 250–265. Springer (2013)
46.
go back to reference Yeh, T., Chang, T.H., Miller, R.C.: Sikuli: using GUI screenshots for search and automation. In: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology, pp 183–192. ACM (2009) Yeh, T., Chang, T.H., Miller, R.C.: Sikuli: using GUI screenshots for search and automation. In: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology, pp 183–192. ACM (2009)
47.
go back to reference Yin, Y., Liu, B., Ni, H.: Real-time embedded software testing method based on extended finite state machine. J. Syst. Eng. Electron. 23(2), 276–285 (2012)CrossRef Yin, Y., Liu, B., Ni, H.: Real-time embedded software testing method based on extended finite state machine. J. Syst. Eng. Electron. 23(2), 276–285 (2012)CrossRef
Metadata
Title
Testing cockpit display systems of aircraft using a model-based approach
Authors
Hassan Sartaj
Muhammad Zohaib Iqbal
Muhammad Uzair Khan
Publication date
04-01-2021
Publisher
Springer Berlin Heidelberg
Published in
Software and Systems Modeling / Issue 6/2021
Print ISSN: 1619-1366
Electronic ISSN: 1619-1374
DOI
https://doi.org/10.1007/s10270-020-00844-z

Other articles of this Issue 6/2021

Software and Systems Modeling 6/2021 Go to the issue

Premium Partner