Skip to main content
Top
Published in: Empirical Software Engineering 1/2021

01-01-2021

Learning by sampling: learning behavioral family models from software product lines

Authors: Carlos Diego Nascimento Damasceno, Mohammad Reza Mousavi, Adenilso da Silva Simao

Published in: Empirical Software Engineering | Issue 1/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Family-based behavioral analysis operates on a single specification artifact, referred to as family model, annotated with feature constraints to express behavioral variability in terms of conditional states and transitions. Family-based behavioral modeling paves the way for efficient model-based analysis of software product lines. Family-based behavioral model learning incorporates feature model analysis and model learning principles to efficiently unify product models into a family model and integrate the behavior of various products into a behavioral family model. Albeit reasonably effective, the exhaustive analysis of product lines is often infeasible due to the potentially exponential number of valid configurations. In this paper, we first present a family-based behavioral model learning techniques, called FFSMDiff. Subsequently, we report on our experience on learning family models by employing product sampling. Using 105 products of six product lines expressed in terms of Mealy machines, we evaluate the precision of family models learned from products selected from different settings of the T-wise product sampling criterion. We show that product sampling can lead to models as precise as those learned by exhaustive analysis and hence, reduce the costs for family model learning.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Appendix
Available only for authorised users
Literature
go back to reference Aichernig BK, Mostowski W, Mousavi MR, Tappler M, Taromirad M (2018) Model learning and model-based testing. In: Bennaceur A, Hähnle R, Meinke K (eds) Machine learning for dynamic software analysis: potentials and limits: International Dagstuhl Seminar 16172, Dagstuhl Castle, Germany, April 24-27, 2016, Revised Papers. https://doi.org/10.1007/978-3-319-96562-8_3. Springer International Publishing, Cham, pp 74–100 Aichernig BK, Mostowski W, Mousavi MR, Tappler M, Taromirad M (2018) Model learning and model-based testing. In: Bennaceur A, Hähnle R, Meinke K (eds) Machine learning for dynamic software analysis: potentials and limits: International Dagstuhl Seminar 16172, Dagstuhl Castle, Germany, April 24-27, 2016, Revised Papers. https://​doi.​org/​10.​1007/​978-3-319-96562-8_​3. Springer International Publishing, Cham, pp 74–100
go back to reference Al-Hajjaji M, Krieter S, Thüm T, Lochau M, Saake G (2016) Incling: efficient product-line testing using incremental pairwise sampling. In: Proceedings of the 2016 ACM SIGPLAN international conference on generative programming: concepts and experiences, GPCE 2016. https://doi.org/10.1145/2993236.2993253. Association for Computing Machinery, New York, pp 144–155 Al-Hajjaji M, Krieter S, Thüm T, Lochau M, Saake G (2016) Incling: efficient product-line testing using incremental pairwise sampling. In: Proceedings of the 2016 ACM SIGPLAN international conference on generative programming: concepts and experiences, GPCE 2016. https://​doi.​org/​10.​1145/​2993236.​2993253. Association for Computing Machinery, New York, pp 144–155
go back to reference Al-Hajjaji M, Lity S, Lachmann R, Thüm T, Schaefer I, Saake G (2017) Delta-oriented product prioritization for similarity-based product-line testing. In: Proceedings of the 2nd international workshop on variability and complexity in software design, VACE ’17. https://doi.org/10.1109/VACE.2017.8. IEEE Press, pp 34–40 Al-Hajjaji M, Lity S, Lachmann R, Thüm T, Schaefer I, Saake G (2017) Delta-oriented product prioritization for similarity-based product-line testing. In: Proceedings of the 2nd international workshop on variability and complexity in software design, VACE ’17. https://​doi.​org/​10.​1109/​VACE.​2017.​8. IEEE Press, pp 34–40
go back to reference Al-Msie’deen R, Huchard M, Seriai A, Urtado C, Vauttier S (2014) Reverse engineering feature models from software configurations using formal concept analysis. In: Bertet K, Rudolph S (eds) Proceedings of the eleventh international conference on concept lattices and their applications, Košice, Slovakia, October 7-10, 2014, CEUR Workshop Proceedings. http://ceur-ws.org/Vol-1252/cla2014_submission_13.pdf, vol 1252. CEUR-WS.org, pp 95–106 Al-Msie’deen R, Huchard M, Seriai A, Urtado C, Vauttier S (2014) Reverse engineering feature models from software configurations using formal concept analysis. In: Bertet K, Rudolph S (eds) Proceedings of the eleventh international conference on concept lattices and their applications, Košice, Slovakia, October 7-10, 2014, CEUR Workshop Proceedings. http://​ceur-ws.​org/​Vol-1252/​cla2014_​submission_​13.​pdf, vol 1252. CEUR-WS.org, pp 95–106
go back to reference Apel S, Kolesnikov S, Siegmund N, Kästner C, Garvin B (2013) Exploring feature interactions in the wild: the new feature-interaction challenge. In: Proceedings of the 5th international workshop on feature-oriented software development. https://doi.org/10.1145/2528265.2528267. ACM, New York, pp 1–8 Apel S, Kolesnikov S, Siegmund N, Kästner C, Garvin B (2013) Exploring feature interactions in the wild: the new feature-interaction challenge. In: Proceedings of the 5th international workshop on feature-oriented software development. https://​doi.​org/​10.​1145/​2528265.​2528267. ACM, New York, pp 1–8
go back to reference Arcuri A, Briand L (2011) A practical guide for using statistical tests to assess randomized algorithms in software engineering. In: Proceedings of the 33rd international conference on software engineering, ICSE ’11. https://doi.org/10.1145/1985793.1985795. Association for Computing Machinery, New York, pp 1–10 Arcuri A, Briand L (2011) A practical guide for using statistical tests to assess randomized algorithms in software engineering. In: Proceedings of the 33rd international conference on software engineering, ICSE ’11. https://​doi.​org/​10.​1145/​1985793.​1985795. Association for Computing Machinery, New York, pp 1–10
go back to reference Asirelli P, ter Beek MH, Fantechi A, Gnesi S, Steffen B (2012) A compositional framework to derive product line behavioural descriptions. In: Margaria T (ed) Leveraging applications of formal methods, verification and validation. Technologies for Mastering Change. https://doi.org/10.1007/978-3-642-34026-0_12. Springer, Berlin, pp 146–161 Asirelli P, ter Beek MH, Fantechi A, Gnesi S, Steffen B (2012) A compositional framework to derive product line behavioural descriptions. In: Margaria T (ed) Leveraging applications of formal methods, verification and validation. Technologies for Mastering Change. https://​doi.​org/​10.​1007/​978-3-642-34026-0_​12. Springer, Berlin, pp 146–161
go back to reference Atlee JM, Beidu S, Fahrenberg U, Legay A (2015) Merging features in featured transition systems. In: Proceedings of the 12th workshop on model-driven engineering, verification and validation co-located with ACM/IEEE 18th international conference on model driven engineering languages and systems. https://hal.inria.fr/hal-01237661, vol 1514. CEUR Workshop Proceedings, Ottawa, Canada, pp 38–43 Atlee JM, Beidu S, Fahrenberg U, Legay A (2015) Merging features in featured transition systems. In: Proceedings of the 12th workshop on model-driven engineering, verification and validation co-located with ACM/IEEE 18th international conference on model driven engineering languages and systems. https://​hal.​inria.​fr/​hal-01237661, vol 1514. CEUR Workshop Proceedings, Ottawa, Canada, pp 38–43
go back to reference Baier C, Katoen JP (2008) Principles of model checking (representation and mind series). The MIT Press Baier C, Katoen JP (2008) Principles of model checking (representation and mind series). The MIT Press
go back to reference Benduhn F, Thüm T, Lochau M, Leich T, Saake G (2015) A survey on modeling techniques for formal behavioral verification of software product lines. In: Proceedings of the ninth international workshop on variability modelling of software-intensive systems, VaMoS ’15. https://doi.org/10.1145/2701319.2701332. Association for Computing Machinery, New York, pp 80–87 Benduhn F, Thüm T, Lochau M, Leich T, Saake G (2015) A survey on modeling techniques for formal behavioral verification of software product lines. In: Proceedings of the ninth international workshop on variability modelling of software-intensive systems, VaMoS ’15. https://​doi.​org/​10.​1145/​2701319.​2701332. Association for Computing Machinery, New York, pp 80–87
go back to reference Beuche D, Schulze M, Duvigneau M (2016) When 150 % is too much: supporting product centric viewpoints in an industrial product line. In: Proceedings of the 20th international systems and software product line conference, SPLC ’16. https://doi.org/10.1145/2934466.2934493. Association for Computing Machinery, New York, pp 262–269 Beuche D, Schulze M, Duvigneau M (2016) When 150 % is too much: supporting product centric viewpoints in an industrial product line. In: Proceedings of the 20th international systems and software product line conference, SPLC ’16. https://​doi.​org/​10.​1145/​2934466.​2934493. Association for Computing Machinery, New York, pp 262–269
go back to reference Brabrand C, Ribeiro M, Tolêdo T, Borba P (2012) Intraprocedural dataflow analysis for software product lines. In: Proceedings of the 11th annual international conference on aspect-oriented software development, AOSD ’12. https://doi.org/10.1145/2162049.2162052. ACM, New York, pp 13–24 Brabrand C, Ribeiro M, Tolêdo T, Borba P (2012) Intraprocedural dataflow analysis for software product lines. In: Proceedings of the 11th annual international conference on aspect-oriented software development, AOSD ’12. https://​doi.​org/​10.​1145/​2162049.​2162052. ACM, New York, pp 13–24
go back to reference Broy M, Jonsson B, Katoen JP, Leucker M, Pretschner A (2005) Part i. testing of finite state machines. In: Broy M, Jonsson B, Katoen JP, Leucker M, Pretschner A (eds) Model-based testing of reactive systems: advanced lectures. https://doi.org/10.1007/11498490_1. Springer, Berlin, pp 1–3 Broy M, Jonsson B, Katoen JP, Leucker M, Pretschner A (2005) Part i. testing of finite state machines. In: Broy M, Jonsson B, Katoen JP, Leucker M, Pretschner A (eds) Model-based testing of reactive systems: advanced lectures. https://​doi.​org/​10.​1007/​11498490_​1. Springer, Berlin, pp 1–3
go back to reference Chapman M, Chockler H, Kesseli P, Kroening D, Strichman O, Tautschnig M (2015) Learning the language of error. In: Finkbeiner B, Pu G, Zhang L (eds) Automated technology for verification and analysis. https://doi.org/10.1007/978-3-319-24953-7_9. Springer International Publishing, Cham, pp 114–130 Chapman M, Chockler H, Kesseli P, Kroening D, Strichman O, Tautschnig M (2015) Learning the language of error. In: Finkbeiner B, Pu G, Zhang L (eds) Automated technology for verification and analysis. https://​doi.​org/​10.​1007/​978-3-319-24953-7_​9. Springer International Publishing, Cham, pp 114–130
go back to reference Classen A, Heymans P, Schobbens PY, Legay A, Raskin JF (2010) Model checking lots of systems: efficient verification of temporal properties in software product lines. In: Proceedings of the 32nd ACM/IEEE international conference on software engineering - volume 1, ICSE ’10. https://doi.org/10.1145/1806799.1806850. Association for Computing Machinery, New York, pp 335–344 Classen A, Heymans P, Schobbens PY, Legay A, Raskin JF (2010) Model checking lots of systems: efficient verification of temporal properties in software product lines. In: Proceedings of the 32nd ACM/IEEE international conference on software engineering - volume 1, ICSE ’10. https://​doi.​org/​10.​1145/​1806799.​1806850. Association for Computing Machinery, New York, pp 335–344
go back to reference Clements PC, Northrop L (2001) Software product lines: practices and patterns. SEI series in software engineering. Addison-Wesley Longman Publishing Co., Inc., Boston Clements PC, Northrop L (2001) Software product lines: practices and patterns. SEI series in software engineering. Addison-Wesley Longman Publishing Co., Inc., Boston
go back to reference Czarnecki K, Bednasch T, Unger P, Eisenecker U (2002) Generative programming for embedded software: an industrial experience report. In: Batory D, Consel C, Taha W (eds) Generative programming and component engineering. https://doi.org/10.1007/3-540-45821-2_10. Series Title: Lecture Notes in Computer Science, vol 2487. Springer Berlin Heidelberg, pp 156–172 Czarnecki K, Bednasch T, Unger P, Eisenecker U (2002) Generative programming for embedded software: an industrial experience report. In: Batory D, Consel C, Taha W (eds) Generative programming and component engineering. https://​doi.​org/​10.​1007/​3-540-45821-2_​10. Series Title: Lecture Notes in Computer Science, vol 2487. Springer Berlin Heidelberg, pp 156–172
go back to reference Damasceno CDN, Masiero PC, Simao A (2016) Evaluating test characteristics and effectiveness of fsm-based testing methods on rbac systems. In: Proceedings of the 30th Brazilian symposium on software engineering, SBES ’16. https://doi.org/10.1145/2973839.2973849. ACM, New York, pp 83–92 Damasceno CDN, Masiero PC, Simao A (2016) Evaluating test characteristics and effectiveness of fsm-based testing methods on rbac systems. In: Proceedings of the 30th Brazilian symposium on software engineering, SBES ’16. https://​doi.​org/​10.​1145/​2973839.​2973849. ACM, New York, pp 83–92
go back to reference Damasceno CDN, Mousavi MR, da Silva Simao A (2019a) Learning to reuse: adaptive model learning for evolving systems. In: Ahrendt W, Tapia Tarifa SL (eds) Integrated formal methods: 15th international conference, IFM 2019, Bergen, Norway, December 2-6, 2019, Proceedings. https://doi.org/10.1007/978-3-030-34968-4_8. Springer International Publishing, Cham, pp 138–156 Damasceno CDN, Mousavi MR, da Silva Simao A (2019a) Learning to reuse: adaptive model learning for evolving systems. In: Ahrendt W, Tapia Tarifa SL (eds) Integrated formal methods: 15th international conference, IFM 2019, Bergen, Norway, December 2-6, 2019, Proceedings. https://​doi.​org/​10.​1007/​978-3-030-34968-4_​8. Springer International Publishing, Cham, pp 138–156
go back to reference Damasceno CDN, Mousavi MR, Simao A (2019b) Learning from difference: an automated approach for learning family models from software product lines. In: Proceedings of the 23rd international systems and software product line conference - volume A, SPLC ’19. https://doi.org/10.1145/3336294.3336307. ACM, New York, pp 52–63 Damasceno CDN, Mousavi MR, Simao A (2019b) Learning from difference: an automated approach for learning family models from software product lines. In: Proceedings of the 23rd international systems and software product line conference - volume A, SPLC ’19. https://​doi.​org/​10.​1145/​3336294.​3336307. ACM, New York, pp 52–63
go back to reference Devroey X, Perrouin G, Legay A, Schobbens PY, Heymans P (2015) Covering spl behaviour with sampled configurations: an initial assessment. In: Proceedings of the ninth international workshop on variability modelling of software-intensive systems, VaMoS ’15. https://doi.org/10.1145/2701319.2701325. ACM, New York, pp 59:59–59:66 Devroey X, Perrouin G, Legay A, Schobbens PY, Heymans P (2015) Covering spl behaviour with sampled configurations: an initial assessment. In: Proceedings of the ninth international workshop on variability modelling of software-intensive systems, VaMoS ’15. https://​doi.​org/​10.​1145/​2701319.​2701325. ACM, New York, pp 59:59–59:66
go back to reference Devroey X, Perrouin G, Legay A, Schobbens PY, Heymans P (2016) Search-based similarity-driven behavioural SPL testing. In: Proceedings of the tenth international workshop on variability modelling of software-intensive systems - VaMoS ’16. https://doi.org/10.1145/2866614.2866627. ACM Press, pp 89–96 Devroey X, Perrouin G, Legay A, Schobbens PY, Heymans P (2016) Search-based similarity-driven behavioural SPL testing. In: Proceedings of the tenth international workshop on variability modelling of software-intensive systems - VaMoS ’16. https://​doi.​org/​10.​1145/​2866614.​2866627. ACM Press, pp 89–96
go back to reference Fenske W, Thüm T, Saake G (2014) A taxonomy of software product line reengineering. In: Proceedings of the eighth international workshop on variability modelling of software-intensive systems, VaMoS ’14. https://doi.org/10.1145/2556624.2556643. Association for Computing Machinery, New York Fenske W, Thüm T, Saake G (2014) A taxonomy of software product line reengineering. In: Proceedings of the eighth international workshop on variability modelling of software-intensive systems, VaMoS ’14. https://​doi.​org/​10.​1145/​2556624.​2556643. Association for Computing Machinery, New York
go back to reference Fischbein D, Uchitel S, Braberman V (2006) A foundation for behavioural conformance in software product line architectures. In: Proceedings of the ISSTA 2006 workshop on role of software architecture for testing and analysis, ROSATEA ’06. https://doi.org/10.1145/1147249.1147254. Association for Computing Machinery, pp 39–48 Fischbein D, Uchitel S, Braberman V (2006) A foundation for behavioural conformance in software product line architectures. In: Proceedings of the ISSTA 2006 workshop on role of software architecture for testing and analysis, ROSATEA ’06. https://​doi.​org/​10.​1145/​1147249.​1147254. Association for Computing Machinery, pp 39–48
go back to reference Fiterău-Broştean P, Howar F (2017) Learning-based testing the sliding window behavior of tcp implementations. In: Petrucci L, Seceleanu C, Cavalcanti A (eds) Critical systems: formal methods and automated verification: joint 22nd international workshop on formal methods for industrial critical systems and 17th international workshop on automated verification of critical systems, FMICS-AVoCS 2017, Turin, Italy, September 18-20, 2017, Proceedings. https://doi.org/10.1007/978-3-319-67113-0_12. Springer International Publishing, Cham, pp 185–200 Fiterău-Broştean P, Howar F (2017) Learning-based testing the sliding window behavior of tcp implementations. In: Petrucci L, Seceleanu C, Cavalcanti A (eds) Critical systems: formal methods and automated verification: joint 22nd international workshop on formal methods for industrial critical systems and 17th international workshop on automated verification of critical systems, FMICS-AVoCS 2017, Turin, Italy, September 18-20, 2017, Proceedings. https://​doi.​org/​10.​1007/​978-3-319-67113-0_​12. Springer International Publishing, Cham, pp 185–200
go back to reference Gill A (1962) Introduction to the theory of finite state machines. McGraw-Hill, New YorkMATH Gill A (1962) Introduction to the theory of finite state machines. McGraw-Hill, New YorkMATH
go back to reference Hafemann Fragal V, Simao A, Mousavi MR (2017) Validated test models for software product lines: featured finite state machines. In: Kouchnarenko O, Khosravi R (eds) Formal aspects of component software: 13th international conference, FACS 2016, Besançon, France, October 19-21, 2016, Revised Selected Papers. https://doi.org/10.1007/978-3-319-57666-4_13. Springer International Publishing, Cham, pp 210–227 Hafemann Fragal V, Simao A, Mousavi MR (2017) Validated test models for software product lines: featured finite state machines. In: Kouchnarenko O, Khosravi R (eds) Formal aspects of component software: 13th international conference, FACS 2016, Besançon, France, October 19-21, 2016, Revised Selected Papers. https://​doi.​org/​10.​1007/​978-3-319-57666-4_​13. Springer International Publishing, Cham, pp 210–227
go back to reference Henard C, Papadakis M, Perrouin G, Klein J, Heymans P, Le Traon Y (2014) Bypassing the combinatorial explosion: using similarity to generate and prioritize t-wise test configurations for software product lines. IEEE Trans Softw Eng 40(7):650–670CrossRef Henard C, Papadakis M, Perrouin G, Klein J, Heymans P, Le Traon Y (2014) Bypassing the combinatorial explosion: using similarity to generate and prioritize t-wise test configurations for software product lines. IEEE Trans Softw Eng 40(7):650–670CrossRef
go back to reference Hess MR, Kromrey JD (2004) Robust confidence intervals for effect sizes: a comparative study of cohen’s d and cliff’s delta under non-normality and heterogeneous variances. In: Annual meeting of the american educational research association Hess MR, Kromrey JD (2004) Robust confidence intervals for effect sizes: a comparative study of cohen’s d and cliff’s delta under non-normality and heterogeneous variances. In: Annual meeting of the american educational research association
go back to reference Holthusen S, Wille D, Legat C, Beddig S, Schaefer I, Vogel-Heuser B (2014) Family model mining for function block diagrams in automation software. In: Proceedings of the 18th international software product line conference on companion volume for workshops, demonstrations and tools - SPLC ’14. https://doi.org/10.1145/2647908.2655965. ACM Press, pp 36–43 Holthusen S, Wille D, Legat C, Beddig S, Schaefer I, Vogel-Heuser B (2014) Family model mining for function block diagrams in automation software. In: Proceedings of the 18th international software product line conference on companion volume for workshops, demonstrations and tools - SPLC ’14. https://​doi.​org/​10.​1145/​2647908.​2655965. ACM Press, pp 36–43
go back to reference Hungar H, Niese O, Steffen B (2003) Domain-specific optimization in automata learning. In: Hunt WA, Somenzi F (eds) Computer aided verification: 15th international conference, CAV 2003, Boulder, CO, USA, July 8-12, 2003. Proceedings. https://doi.org/10.1007/978-3-540-45069-6_31. Springer, Berlin, pp 315–327 Hungar H, Niese O, Steffen B (2003) Domain-specific optimization in automata learning. In: Hunt WA, Somenzi F (eds) Computer aided verification: 15th international conference, CAV 2003, Boulder, CO, USA, July 8-12, 2003. Proceedings. https://​doi.​org/​10.​1007/​978-3-540-45069-6_​31. Springer, Berlin, pp 315–327
go back to reference Isberner M, Howar F, Steffen B (2015) The open-source learnlib. In: Kroening D, Păsăreanu CS (eds) Computer aided verification: 27th international conference, CAV 2015, San Francisco, CA, USA, July 18-24, 2015, Proceedings, Part I. https://doi.org/10.1007/978-3-319-21690-4_32. Springer International Publishing, Cham, pp 487–495 Isberner M, Howar F, Steffen B (2015) The open-source learnlib. In: Kroening D, Păsăreanu CS (eds) Computer aided verification: 27th international conference, CAV 2015, San Francisco, CA, USA, July 18-24, 2015, Proceedings, Part I. https://​doi.​org/​10.​1007/​978-3-319-21690-4_​32. Springer International Publishing, Cham, pp 487–495
go back to reference Kuhn DR, Kacker RN, Lei Y (2013) Introduction to combinatorial testing, 1st. Chapman & Hall/CRC, Boca RatonMATH Kuhn DR, Kacker RN, Lei Y (2013) Introduction to combinatorial testing, 1st. Chapman & Hall/CRC, Boca RatonMATH
go back to reference Kunze S, Mostowski W, Mousavi MR, Varshosaz M (2016) Generation of failure models through automata learning. In: 2016 workshop on automotive systems/software architectures (WASA). https://doi.org/10.1109/WASA.2016.7. IEEE Computer Society, Los Alamitos, pp 22–25 Kunze S, Mostowski W, Mousavi MR, Varshosaz M (2016) Generation of failure models through automata learning. In: 2016 workshop on automotive systems/software architectures (WASA). https://​doi.​org/​10.​1109/​WASA.​2016.​7. IEEE Computer Society, Los Alamitos, pp 22–25
go back to reference Lang KJ, Pearlmutter BA, Price RA (1998) Results of the abbadingo one dfa learning competition and a new evidence-driven state merging algorithm. In: Proceedings of the 4th international colloquium on grammatical inference, ICGI ’98. https://doi.org/10.1007/BFb0054059. Springer, Berlin, pp 1–12 Lang KJ, Pearlmutter BA, Price RA (1998) Results of the abbadingo one dfa learning competition and a new evidence-driven state merging algorithm. In: Proceedings of the 4th international colloquium on grammatical inference, ICGI ’98. https://​doi.​org/​10.​1007/​BFb0054059. Springer, Berlin, pp 1–12
go back to reference Linden FJVD, Schmid K, Rommes E (2007) Software product lines in action: the best industrial practice in product line engineering. Springer-Verlag New York, Inc., SecaucusCrossRef Linden FJVD, Schmid K, Rommes E (2007) Software product lines in action: the best industrial practice in product line engineering. Springer-Verlag New York, Inc., SecaucusCrossRef
go back to reference Lopez-Herrejon RE, Ferrer J, Chicano F, Egyed A, Alba E (2014) Comparative analysis of classical multi-objective evolutionary algorithms and seeding strategies for pairwise testing of software product lines. In: 2014 IEEE congress on evolutionary computation (CEC). https://doi.org/10.1109/CEC.2014.6900473, pp 387–396 Lopez-Herrejon RE, Ferrer J, Chicano F, Egyed A, Alba E (2014) Comparative analysis of classical multi-objective evolutionary algorithms and seeding strategies for pairwise testing of software product lines. In: 2014 IEEE congress on evolutionary computation (CEC). https://​doi.​org/​10.​1109/​CEC.​2014.​6900473, pp 387–396
go back to reference Luthmann L, Stephan A, Bürdek J, Lochau M (2017) Modeling and testing product lines with unbounded parametric real-time constraints. In: Proceedings of the 21st international systems and software product line conference - volume A on - SPLC ’17. https://doi.org/10.1145/3106195.3106204. ACM Press, pp 104–113 Luthmann L, Stephan A, Bürdek J, Lochau M (2017) Modeling and testing product lines with unbounded parametric real-time constraints. In: Proceedings of the 21st international systems and software product line conference - volume A on - SPLC ’17. https://​doi.​org/​10.​1145/​3106195.​3106204. ACM Press, pp 104–113
go back to reference Neider D, Smetsers R, Vaandrager F, Kuppens H (2019) Benchmarks for automata learning and conformance testing. In: Margaria T, Graf S, Larsen KG (eds) Models, mindsets, meta: the what, the how, and the why not? Essays dedicated to Bernhard Steffen on the occasion of his 60th birthday. https://doi.org/10.1007/978-3-030-22348-9_23. Springer International Publishing, pp 390–416 Neider D, Smetsers R, Vaandrager F, Kuppens H (2019) Benchmarks for automata learning and conformance testing. In: Margaria T, Graf S, Larsen KG (eds) Models, mindsets, meta: the what, the how, and the why not? Essays dedicated to Bernhard Steffen on the occasion of his 60th birthday. https://​doi.​org/​10.​1007/​978-3-030-22348-9_​23. Springer International Publishing, pp 390–416
go back to reference Peled D, Vardi MY, Yannakakis M (1999) Black box checking. In: Wu J, Chanson ST, Gao Q (eds) Formal methods for protocol engineering and distributed systems: FORTE XII / PSTV XIX’99 IFIP TC6 WG6.1 Joint international conference on formal description techniques for distributed systems and communication protocols (FORTE XII) and protocol specification, testing and verification (PSTV XIX) October 5–8, 1999, Beijing, China. https://doi.org/10.1007/978-0-387-35578-8_13. Springer US, Boston, pp 225–240 Peled D, Vardi MY, Yannakakis M (1999) Black box checking. In: Wu J, Chanson ST, Gao Q (eds) Formal methods for protocol engineering and distributed systems: FORTE XII / PSTV XIX’99 IFIP TC6 WG6.1 Joint international conference on formal description techniques for distributed systems and communication protocols (FORTE XII) and protocol specification, testing and verification (PSTV XIX) October 5–8, 1999, Beijing, China. https://​doi.​org/​10.​1007/​978-0-387-35578-8_​13. Springer US, Boston, pp 225–240
go back to reference Perrouin G, Sen S, Klein J, Baudry Bl, Traon Y (2010) Automated and scalable t-wise test case generation strategies for software product lines. In: 2010 third international conference on software testing, verification and validation. https://doi.org/10.1109/ICST.2010.43, pp 459–468 Perrouin G, Sen S, Klein J, Baudry Bl, Traon Y (2010) Automated and scalable t-wise test case generation strategies for software product lines. In: 2010 third international conference on software testing, verification and validation. https://​doi.​org/​10.​1109/​ICST.​2010.​43, pp 459–468
go back to reference Petke J, Yoo S, Cohen MB, Harman M (2013) Efficiency and early fault detection with lower and higher strength combinatorial interaction testing. In: Proceedings of the 2013 9th joint meeting on foundations of software engineering, ESEC/FSE 2013. https://doi.org/10.1145/2491411.2491436. ACM, New York, pp 26–36 Petke J, Yoo S, Cohen MB, Harman M (2013) Efficiency and early fault detection with lower and higher strength combinatorial interaction testing. In: Proceedings of the 2013 9th joint meeting on foundations of software engineering, ESEC/FSE 2013. https://​doi.​org/​10.​1145/​2491411.​2491436. ACM, New York, pp 26–36
go back to reference Pohl K, Böckle G, Linden FJVD (2005) Software product line engineering: foundations, principles and techniques. Springer-Verlag New York, Inc., SecaucusMATHCrossRef Pohl K, Böckle G, Linden FJVD (2005) Software product line engineering: foundations, principles and techniques. Springer-Verlag New York, Inc., SecaucusMATHCrossRef
go back to reference Raffelt H, Steffen B (2006) Learnlib: a library for automata learning and experimentation. In: Baresi L, Heckel R (eds) Fundamental approaches to software engineering: 9th international conference, FASE 2006, held as part of the joint european conferences on theory and practice of software, ETAPS 2006, Vienna, Austria, March 27-28, 2006. Proceedings. https://doi.org/10.1007/11693017_28. Springer, Berlin, pp 377–380 Raffelt H, Steffen B (2006) Learnlib: a library for automata learning and experimentation. In: Baresi L, Heckel R (eds) Fundamental approaches to software engineering: 9th international conference, FASE 2006, held as part of the joint european conferences on theory and practice of software, ETAPS 2006, Vienna, Austria, March 27-28, 2006. Proceedings. https://​doi.​org/​10.​1007/​11693017_​28. Springer, Berlin, pp 377–380
go back to reference Sabouri H, Khosravi R (2013) Delta modeling and model checking of product families. In: Arbab F, Sirjani M (eds) Fundamentals of software engineering: 5th international conference, FSEN 2013, Tehran, Iran, April 24-26, 2013, Revised Selected Papers. https://doi.org/10.1007/978-3-642-40213-5_4. Springer, Berlin, pp 51–65 Sabouri H, Khosravi R (2013) Delta modeling and model checking of product families. In: Arbab F, Sirjani M (eds) Fundamentals of software engineering: 5th international conference, FSEN 2013, Tehran, Iran, April 24-26, 2013, Revised Selected Papers. https://​doi.​org/​10.​1007/​978-3-642-40213-5_​4. Springer, Berlin, pp 51–65
go back to reference Schaefer I, Bettini L, Bono V, Damiani F, Tanzarella N (2010) Delta-oriented programming of software product lines. In: Bosch J, Lee J (eds) Software product lines: going beyond: 14th international conference, SPLC 2010, Jeju Island, South Korea, September 13-17, 2010. Proceedings. https://doi.org/10.1007/978-3-642-15579-6_6. Springer, Berlin, pp 77–91 Schaefer I, Bettini L, Bono V, Damiani F, Tanzarella N (2010) Delta-oriented programming of software product lines. In: Bosch J, Lee J (eds) Software product lines: going beyond: 14th international conference, SPLC 2010, Jeju Island, South Korea, September 13-17, 2010. Proceedings. https://​doi.​org/​10.​1007/​978-3-642-15579-6_​6. Springer, Berlin, pp 77–91
go back to reference Schuts M, Hooman J, Vaandrager F (2016) Refactoring of legacy software using model learning and equivalence checking: an industrial experience report. In: Ábrahám E, Huisman M (eds) Integrated formal methods: 12th international conference, IFM 2016, Reykjavik, Iceland, June 1-5, 2016, Proceedings. https://doi.org/10.1007/978-3-319-33693-0_20. Springer International Publishing, Cham, pp 311–325 Schuts M, Hooman J, Vaandrager F (2016) Refactoring of legacy software using model learning and equivalence checking: an industrial experience report. In: Ábrahám E, Huisman M (eds) Integrated formal methods: 12th international conference, IFM 2016, Reykjavik, Iceland, June 1-5, 2016, Proceedings. https://​doi.​org/​10.​1007/​978-3-319-33693-0_​20. Springer International Publishing, Cham, pp 311–325
go back to reference Steffens M, Oster S, Lochau M, Fogdal T (2012) Industrial evaluation of pairwise spl testing with moso-polite. In: Proceedings of the sixth international workshop on variability modeling of software-intensive systems, VaMoS ’12. https://doi.org/10.1145/2110147.2110154. ACM, New York, pp 55–62 Steffens M, Oster S, Lochau M, Fogdal T (2012) Industrial evaluation of pairwise spl testing with moso-polite. In: Proceedings of the sixth international workshop on variability modeling of software-intensive systems, VaMoS ’12. https://​doi.​org/​10.​1145/​2110147.​2110154. ACM, New York, pp 55–62
go back to reference Svendsen A, Zhang X, Lind-Tviberg R, Fleurey F, Haugen Ø, Møller-Pedersen B, Olsen GK (2010) Developing a software product line for train control: a case study of CVL. In: Bosch J, Lee J (eds) Software product lines: going beyond. https://doi.org/10.1007/978-3-642-15579-6_8. Series Title: Lecture Notes in Computer Science, vol 6287. Springer, Berlin, pp 106–120 Svendsen A, Zhang X, Lind-Tviberg R, Fleurey F, Haugen Ø, Møller-Pedersen B, Olsen GK (2010) Developing a software product line for train control: a case study of CVL. In: Bosch J, Lee J (eds) Software product lines: going beyond. https://​doi.​org/​10.​1007/​978-3-642-15579-6_​8. Series Title: Lecture Notes in Computer Science, vol 6287. Springer, Berlin, pp 106–120
go back to reference ter Beek MH, de Vink EP, Willemse TAC (2017) Family-based model checking with mcrl2. In: Huisman M, Rubin J (eds) Fundamental approaches to software engineering: 20th international conference, FASE 2017, held as part of the european joint conferences on theory and practice of software, ETAPS 2017, Uppsala, Sweden, April 22-29, 2017, Proceedings. https://doi.org/10.1007/978-3-662-54494-5_23. Springer, Berlin, pp 387–405 ter Beek MH, de Vink EP, Willemse TAC (2017) Family-based model checking with mcrl2. In: Huisman M, Rubin J (eds) Fundamental approaches to software engineering: 20th international conference, FASE 2017, held as part of the european joint conferences on theory and practice of software, ETAPS 2017, Uppsala, Sweden, April 22-29, 2017, Proceedings. https://​doi.​org/​10.​1007/​978-3-662-54494-5_​23. Springer, Berlin, pp 387–405
go back to reference ter Beek MH, Damiani F, Lienhardt M, Mazzanti F, Paolini L (2019b) Static analysis of featured transition systems: [research]. In: Proceedings of the 23rd international systems and software product line conference - volume A - SPLC ’19. https://doi.org/10.1145/3336294.3336295. ACM Press, pp 1–13 ter Beek MH, Damiani F, Lienhardt M, Mazzanti F, Paolini L (2019b) Static analysis of featured transition systems: [research]. In: Proceedings of the 23rd international systems and software product line conference - volume A - SPLC ’19. https://​doi.​org/​10.​1145/​3336294.​3336295. ACM Press, pp 1–13
go back to reference von Rhein A, Grebhahn A, Apel S, Siegmund N, Beyer D, Berger T (2015) Presence-condition simplification in highly configurable systems. In: Proceedings of the 37th international conference on software engineering - volume 1, ICSE ’15. https://doi.org/10.5555/2818754.2818779. IEEE, Piscataway, pp 178–188 von Rhein A, Grebhahn A, Apel S, Siegmund N, Beyer D, Berger T (2015) Presence-condition simplification in highly configurable systems. In: Proceedings of the 37th international conference on software engineering - volume 1, ICSE ’15. https://​doi.​org/​10.​5555/​2818754.​2818779. IEEE, Piscataway, pp 178–188
go back to reference Varshosaz M, Al-Hajjaji M, Thüm T, Runge T, Mousavi MR, Schaefer I (2018) A classification of product sampling for software product lines. In: Proceedings of the 22Nd international systems and software product line conference - volume 1, SPLC ’18. https://doi.org/10.1145/3233027.3233035. ACM, New York, pp 1–13 Varshosaz M, Al-Hajjaji M, Thüm T, Runge T, Mousavi MR, Schaefer I (2018) A classification of product sampling for software product lines. In: Proceedings of the 22Nd international systems and software product line conference - volume 1, SPLC ’18. https://​doi.​org/​10.​1145/​3233027.​3233035. ACM, New York, pp 1–13
go back to reference Varshosaz M, Khosravi R (2013) Discrete time markov chain families: modeling and verification of probabilistic software product lines. In: Proceedings of the 17th international software product line conference co-located workshops on - SPLC ’13 Workshops. https://doi.org/10.1145/2499777.2500725. ACM Press, p 34 Varshosaz M, Khosravi R (2013) Discrete time markov chain families: modeling and verification of probabilistic software product lines. In: Proceedings of the 17th international software product line conference co-located workshops on - SPLC ’13 Workshops. https://​doi.​org/​10.​1145/​2499777.​2500725. ACM Press, p 34
Metadata
Title
Learning by sampling: learning behavioral family models from software product lines
Authors
Carlos Diego Nascimento Damasceno
Mohammad Reza Mousavi
Adenilso da Silva Simao
Publication date
01-01-2021
Publisher
Springer US
Published in
Empirical Software Engineering / Issue 1/2021
Print ISSN: 1382-3256
Electronic ISSN: 1573-7616
DOI
https://doi.org/10.1007/s10664-020-09912-w

Other articles of this Issue 1/2021

Empirical Software Engineering 1/2021 Go to the issue

Premium Partner