Skip to main content
Erschienen in: Empirical Software Engineering 1/2019

04.04.2018

Studying the consistency of star ratings and reviews of popular free hybrid Android and iOS apps

verfasst von: Hanyang Hu, Shaowei Wang, Cor-Paul Bezemer, Ahmed E. Hassan

Erschienen in: Empirical Software Engineering | Ausgabe 1/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Nowadays, many developers make their mobile apps available on multiple platforms (e.g., Android and iOS). However, maintaining several versions of a cross-platform app that is built natively (i.e., using platform-specific tools) is a complicated task. Instead, developers can choose to use hybrid development tools, such as PhoneGap, to build hybrid apps. Hybrid apps are based on a single codebase across platforms. There exist two ways to use a hybrid development tool to build a hybrid app that runs on multiple platforms: (1) using web technologies (i.e., HTML, Javascript and CSS) and (2) in a common language, which is then converted to native code. We study whether these hybrid development tools achieve their main purpose: delivering an app that is perceived similarly by users across platforms. Prior studies show that users refer to star ratings and user reviews, when deciding to download an app. Given the importance of star ratings and user reviews, we study whether the usage of a hybrid development tool assists app developers in achieving consistency in the star ratings and user reviews across multiple platforms. We study 68 hybrid app-pairs, i.e., apps that exist both in the Google Play store and Apple App store. We find that 33 out of 68 hybrid apps do not receive consistent star ratings across platforms. We run Twitter-LDA on user reviews and find that the star ratings of the reviews that discuss the same topic could be up to three times as high across platforms. Our findings suggest that while hybrid apps are better at providing consistent star ratings and user reviews when compared to cross-platform apps that are built natively, hybrid apps do not guarantee such consistency. Hence, developers should not solely rely on hybrid development tools to achieve consistency in the star ratings and reviews that are given by users of their apps. In particular, developers should track closely the ratings and reviews of their apps across platforms, so that they can act accordingly when platform-specific issues arise.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Ali M, Mesbah A (2016) Mining and characterizing hybrid apps. In: Proceedings of the International Workshop on App Market Analytics (WAMA), ACM, pp 50–56 Ali M, Mesbah A (2016) Mining and characterizing hybrid apps. In: Proceedings of the International Workshop on App Market Analytics (WAMA), ACM, pp 50–56
Zurück zum Zitat Benenson Z, Gassmann F, Reinfelder L (2013) Android and iOS users’ differences concerning security and privacy. In: Extended Abstracts on Human Factors in Computing Systems (CHI), pp 817–822 Benenson Z, Gassmann F, Reinfelder L (2013) Android and iOS users’ differences concerning security and privacy. In: Extended Abstracts on Human Factors in Computing Systems (CHI), pp 817–822
Zurück zum Zitat Blei D M, Ng A Y, Jordan M I (2003) Latent dirichlet allocation. J Mach Learn Res 3:993–1022MATH Blei D M, Ng A Y, Jordan M I (2003) Latent dirichlet allocation. J Mach Learn Res 3:993–1022MATH
Zurück zum Zitat Chen N, Lin J, Hoi S C H, Xiao X, Zhang B (2014) Ar-miner: Mining informative reviews for developers from mobile app marketplace. In: Proceedings of the 36th International Conference on Software Engineering (ICSE). ACM, New York, pp 767–778 Chen N, Lin J, Hoi S C H, Xiao X, Zhang B (2014) Ar-miner: Mining informative reviews for developers from mobile app marketplace. In: Proceedings of the 36th International Conference on Software Engineering (ICSE). ACM, New York, pp 767–778
Zurück zum Zitat Dalmasso I, Datta SK, Bonnet C, Nikaein N (2013) Survey, comparison and evaluation of cross platform mobile application development tools. In: 2013 9th International Wireless Communications and Mobile Computing Conference (IWCMC), pp 323–328 Dalmasso I, Datta SK, Bonnet C, Nikaein N (2013) Survey, comparison and evaluation of cross platform mobile application development tools. In: 2013 9th International Wireless Communications and Mobile Computing Conference (IWCMC), pp 323–328
Zurück zum Zitat Di Sorbo A, Panichella S, Alexandru C V, Shimagaki J, Visaggio C A, Canfora G, Gall HC (2016) What would users change in my app? Summarizing app reviews for recommending software changes. In: Proceedings of the 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering (FSE), ACM, pp 499–510 Di Sorbo A, Panichella S, Alexandru C V, Shimagaki J, Visaggio C A, Canfora G, Gall HC (2016) What would users change in my app? Summarizing app reviews for recommending software changes. In: Proceedings of the 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering (FSE), ACM, pp 499–510
Zurück zum Zitat Fu B, Lin J, Li L, Faloutsos C, Hong J, Sadeh N (2013) Why people hate your app: Making sense of user feedback in a mobile app store. In: Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD). ACM, New York, pp 1276–1284 Fu B, Lin J, Li L, Faloutsos C, Hong J, Sadeh N (2013) Why people hate your app: Making sense of user feedback in a mobile app store. In: Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD). ACM, New York, pp 1276–1284
Zurück zum Zitat Gu X, Kim S (2015) What parts of your apps are loved by users? In: 30th IEEE/ACM International Conference on Automated Software Engineering (ASE), pp 760–770 Gu X, Kim S (2015) What parts of your apps are loved by users? In: 30th IEEE/ACM International Conference on Automated Software Engineering (ASE), pp 760–770
Zurück zum Zitat Guzman E, Maalej W (2014) How do users like this feature? [a] fine grained sentiment analysis of app reviews. In: 22nd International Requirements Engineering Conference (RE), IEEE, pp 153–162 Guzman E, Maalej W (2014) How do users like this feature? [a] fine grained sentiment analysis of app reviews. In: 22nd International Requirements Engineering Conference (RE), IEEE, pp 153–162
Zurück zum Zitat Harman M, Jia Y, Zhang Y (2012) App store mining and analysis: MSR for app stores. In: 9th Working Conference on Mining Software Repositories (MSR), IEEE, pp 108–111 Harman M, Jia Y, Zhang Y (2012) App store mining and analysis: MSR for app stores. In: 9th Working Conference on Mining Software Repositories (MSR), IEEE, pp 108–111
Zurück zum Zitat Hassan S, Shang W, Hassan A E (2017) An empirical study of emergency updates for top Android mobile apps. Empir Softw Eng 22(1):505–546CrossRef Hassan S, Shang W, Hassan A E (2017) An empirical study of emergency updates for top Android mobile apps. Empir Softw Eng 22(1):505–546CrossRef
Zurück zum Zitat Heitkötter H, Hanschke S, Majchrzak T A (2013) Evaluating cross-platform development approaches for mobile applications. Springer Berlin Heidelberg, Berlin, pp 120–138 Heitkötter H, Hanschke S, Majchrzak T A (2013) Evaluating cross-platform development approaches for mobile applications. Springer Berlin Heidelberg, Berlin, pp 120–138
Zurück zum Zitat Joanes D N, Gill C A (1998) Comparing measures of sample skewness and kurtosis. J R Stat Soc Ser D (Stat) 47(1):183–189CrossRef Joanes D N, Gill C A (1998) Comparing measures of sample skewness and kurtosis. J R Stat Soc Ser D (Stat) 47(1):183–189CrossRef
Zurück zum Zitat Joorabchi M, Mesbah A, Kruchten P (2013) Real challenges in mobile app development. In: International Symposium on Empirical Software Engineering and Measurement (ESEM), IEEE/ACM, pp 15–24 Joorabchi M, Mesbah A, Kruchten P (2013) Real challenges in mobile app development. In: International Symposium on Empirical Software Engineering and Measurement (ESEM), IEEE/ACM, pp 15–24
Zurück zum Zitat Joorabchi ME, Ali M, Mesbah A (2015) Detecting inconsistencies in multi-platform mobile apps. In: IEEE 26th International Symposium on Software Reliability Engineering (ISSRE), pp 450–460 Joorabchi ME, Ali M, Mesbah A (2015) Detecting inconsistencies in multi-platform mobile apps. In: IEEE 26th International Symposium on Software Reliability Engineering (ISSRE), pp 450–460
Zurück zum Zitat Khalid H, Shihab E, Nagappan M, Hassan A E (2015) What do mobile app users complain about IEEE Soft 32(3):70–77CrossRef Khalid H, Shihab E, Nagappan M, Hassan A E (2015) What do mobile app users complain about IEEE Soft 32(3):70–77CrossRef
Zurück zum Zitat Long J D, Feng D, Cliff N (2003) Ordinal analysis of behavioral data. Wiley, New YorkCrossRef Long J D, Feng D, Cliff N (2003) Ordinal analysis of behavioral data. Wiley, New YorkCrossRef
Zurück zum Zitat Man Y, Gao C, Lyu MR, Jiang J (2016) Experience report: Understanding cross-platform app issues from user reviews. In: IEEE 27th International Symposium on Software Reliability Engineering (ISSRE), pp 138–149 Man Y, Gao C, Lyu MR, Jiang J (2016) Experience report: Understanding cross-platform app issues from user reviews. In: IEEE 27th International Symposium on Software Reliability Engineering (ISSRE), pp 138–149
Zurück zum Zitat Mann H B, Whitney D R (1947) On a test of whether one of two random variables is stochastically larger than the other. Ann Math Statist 18(1):50–60MathSciNetCrossRefMATH Mann H B, Whitney D R (1947) On a test of whether one of two random variables is stochastically larger than the other. Ann Math Statist 18(1):50–60MathSciNetCrossRefMATH
Zurück zum Zitat Martin W, Harman M, Jia Y, Sarro F, Zhang Y (2015) The app sampling problem for app store mining. In: Proceedings of the 12th Working Conference on Mining Software Repositories (MSR), IEEE Press, pp 123–133 Martin W, Harman M, Jia Y, Sarro F, Zhang Y (2015) The app sampling problem for app store mining. In: Proceedings of the 12th Working Conference on Mining Software Repositories (MSR), IEEE Press, pp 123–133
Zurück zum Zitat Martin W, Sarro F, Harman M (2016a) Causal impact analysis for app releases in google play. In: Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering (FSE). ACM, New York, pp 435–446 Martin W, Sarro F, Harman M (2016a) Causal impact analysis for app releases in google play. In: Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering (FSE). ACM, New York, pp 435–446
Zurück zum Zitat Martin W, Sarro F, Jia Y, Zhang Y, Harman M (2016b) A survey of app store analysis for software engineering. IEEE Trans. Softw. Eng. PP(99):1–32 Martin W, Sarro F, Jia Y, Zhang Y, Harman M (2016b) A survey of app store analysis for software engineering. IEEE Trans. Softw. Eng. PP(99):1–32
Zurück zum Zitat Noei E, Syer M D, Zou Y, Hassan A E, Keivanloo I (2017) A study of the relation of mobile device attributes with the user-perceived quality of Android apps. Empir Softw Eng 22:1–29CrossRef Noei E, Syer M D, Zou Y, Hassan A E, Keivanloo I (2017) A study of the relation of mobile device attributes with the user-perceived quality of Android apps. Empir Softw Eng 22:1–29CrossRef
Zurück zum Zitat Ohrt J, Turau V (2012) Cross-platform development tools for smartphone applications. Computer 45(9):72–79CrossRef Ohrt J, Turau V (2012) Cross-platform development tools for smartphone applications. Computer 45(9):72–79CrossRef
Zurück zum Zitat Pagano D, Maalej W (2013) User feedback in the appstore: An empirical study. In: 21st International Requirements Engineering Conference (RE), IEEE, pp 125–134 Pagano D, Maalej W (2013) User feedback in the appstore: An empirical study. In: 21st International Requirements Engineering Conference (RE), IEEE, pp 125–134
Zurück zum Zitat Palmieri M, Singh I, Cicchetti A (2012) Comparison of cross-platform mobile development tools. In: 2012 16th International Conference on Intelligence in Next Generation Networks (ICIN), pp 179–186 Palmieri M, Singh I, Cicchetti A (2012) Comparison of cross-platform mobile development tools. In: 2012 16th International Conference on Intelligence in Next Generation Networks (ICIN), pp 179–186
Zurück zum Zitat Palomba F, Linares-Vásquez M, Bavota G, Oliveto R, Penta MD, Poshyvanyk D, Lucia AD (2015) User reviews matter! tracking crowdsourced reviews to support evolution of successful apps. In: 2015 IEEE International Conference on Software Maintenance and Evolution (ICSME), pp 291–300 Palomba F, Linares-Vásquez M, Bavota G, Oliveto R, Penta MD, Poshyvanyk D, Lucia AD (2015) User reviews matter! tracking crowdsourced reviews to support evolution of successful apps. In: 2015 IEEE International Conference on Software Maintenance and Evolution (ICSME), pp 291–300
Zurück zum Zitat Palomba F, Salza P, Ciurumelea A, Panichella S, Gall H, Ferrucci F, De Lucia A (2017) Recommending and localizing change requests for mobile apps based on user reviews. In: Proceedings of the 39th International Conference on Software Engineering (ICSE). IEEE Press, Piscataway, pp 106–117 Palomba F, Salza P, Ciurumelea A, Panichella S, Gall H, Ferrucci F, De Lucia A (2017) Recommending and localizing change requests for mobile apps based on user reviews. In: Proceedings of the 39th International Conference on Software Engineering (ICSE). IEEE Press, Piscataway, pp 106–117
Zurück zum Zitat Panichella S, Sorbo A D, Guzman E, Visaggio C A, Canfora G, Gall HC (2015) How can I improve my app? Classifying user reviews for software maintenance and evolution. In: International Conference on Software Maintenance and Evolution (ICSME), IEEE, pp 281–290 Panichella S, Sorbo A D, Guzman E, Visaggio C A, Canfora G, Gall HC (2015) How can I improve my app? Classifying user reviews for software maintenance and evolution. In: International Conference on Software Maintenance and Evolution (ICSME), IEEE, pp 281–290
Zurück zum Zitat Porter M F (1997) Readings in information retrieval. Morgan Kaufmann Publishers Inc., chap An Algorithm for Suffix Stripping, pp 313–316 Porter M F (1997) Readings in information retrieval. Morgan Kaufmann Publishers Inc., chap An Algorithm for Suffix Stripping, pp 313–316
Zurück zum Zitat Romano J, Kromrey J D, Coraggio J, Skowronek J, Devine L (2006) Exploring methods for evaluating group differences on the NSSE and other surveys: Are the t-test and Cohen’s d indices the most appropriate choices. In: Annual meeting of the Southern Association for Institutional Research Romano J, Kromrey J D, Coraggio J, Skowronek J, Devine L (2006) Exploring methods for evaluating group differences on the NSSE and other surveys: Are the t-test and Cohen’s d indices the most appropriate choices. In: Annual meeting of the Southern Association for Institutional Research
Zurück zum Zitat Smutný P (2012) Mobile development tools and cross-platform solutions. In: Carpathian Control Conference (ICCC), 2012 13th International, pp 653–656 Smutný P (2012) Mobile development tools and cross-platform solutions. In: Carpathian Control Conference (ICCC), 2012 13th International, pp 653–656
Zurück zum Zitat Thomas S W, Adams B, Hassan A E, Blostein D (2011) Modeling the evolution of topics in source code histories. In: Proceedings of the 8th Working Conference on Mining Software Repositories (MSR), ACM, pp 173–182 Thomas S W, Adams B, Hassan A E, Blostein D (2011) Modeling the evolution of topics in source code histories. In: Proceedings of the 8th Working Conference on Mining Software Repositories (MSR), ACM, pp 173–182
Zurück zum Zitat Tian Y, Nagappan M, Lo D, Hassan AE (2015) What are the characteristics of high-rated apps? A case study on free Android applications. In: IEEE International Conference on Software Maintenance and Evolution (ICSME), pp 301–310 Tian Y, Nagappan M, Lo D, Hassan AE (2015) What are the characteristics of high-rated apps? A case study on free Android applications. In: IEEE International Conference on Software Maintenance and Evolution (ICSME), pp 301–310
Zurück zum Zitat Viennot N, Garcia E, Nieh J (2014) A measurement study of google play. SIGMETRICS Perform Eval Rev 42(1):221–233CrossRef Viennot N, Garcia E, Nieh J (2014) A measurement study of google play. SIGMETRICS Perform Eval Rev 42(1):221–233CrossRef
Zurück zum Zitat Villarroel L, Bavota G, Russo B, Oliveto R, Di Penta M (2016) Release planning of mobile apps based on user reviews. In: Proceedings of the 38th International Conference on Software Engineering (ICSE). ACM, New York, pp 14–24 Villarroel L, Bavota G, Russo B, Oliveto R, Di Penta M (2016) Release planning of mobile apps based on user reviews. In: Proceedings of the 38th International Conference on Software Engineering (ICSE). ACM, New York, pp 14–24
Zurück zum Zitat Vu PM, Nguyen TT, Pham HV, Nguyen TT (2015) Mining user opinions in mobile app reviews: A keyword-based approach. In: 30th IEEE/ACM International Conference on Automated Software Engineering (ASE), pp 749–759 Vu PM, Nguyen TT, Pham HV, Nguyen TT (2015) Mining user opinions in mobile app reviews: A keyword-based approach. In: 30th IEEE/ACM International Conference on Automated Software Engineering (ASE), pp 749–759
Zurück zum Zitat Zhao W X, Jiang J, Weng J, He J, Lim E P, Yan H, Li X (2011) Comparing Twitter and traditional media using topic models. In: Proceedings of the 33rd European Conference on Advances in Information Retrieval (ECIR), Springer-Verlag, pp 338–349CrossRef Zhao W X, Jiang J, Weng J, He J, Lim E P, Yan H, Li X (2011) Comparing Twitter and traditional media using topic models. In: Proceedings of the 33rd European Conference on Advances in Information Retrieval (ECIR), Springer-Verlag, pp 338–349CrossRef
Metadaten
Titel
Studying the consistency of star ratings and reviews of popular free hybrid Android and iOS apps
verfasst von
Hanyang Hu
Shaowei Wang
Cor-Paul Bezemer
Ahmed E. Hassan
Publikationsdatum
04.04.2018
Verlag
Springer US
Erschienen in
Empirical Software Engineering / Ausgabe 1/2019
Print ISSN: 1382-3256
Elektronische ISSN: 1573-7616
DOI
https://doi.org/10.1007/s10664-018-9617-6

Weitere Artikel der Ausgabe 1/2019

Empirical Software Engineering 1/2019 Zur Ausgabe

Premium Partner