Skip to main content
Fachgebiete
Automobil + Motoren Bauwesen + Immobilien Business IT + Informatik Elektrotechnik + Elektronik Energie + Nachhaltigkeit Finance + Banking Management + Führung Marketing + Vertrieb Maschinenbau + Werkstoffe Versicherung + Risiko
DE
EN
Bücher
Zeitschriften
Themenseiten
Organisationspsychologie Projektmanagement Marketing Smart Manufacturing
Weitere Formate
Podcasts Webinare Technik Webinare Wirtschaft Kongresse Veranstaltungskalender Awards
Jetzt Einzelzugang starten
Zugang für Unternehmen
Referenzkunden
SLX-Digitalkonferenz: Zukunftswerkstatt 2024

Mehr Umsatz mit Top-Kontakten

Am 7. Mai erfahren Sie, wie Vertriebsteams Leadgenerierung, Leadnurturing und Leadstrategien effizient steuern können.
Erweiterte Suche
Anmelden
nach oben
Journal of the Academy of Marketing Science
Erschienen in: Journal of the Academy of Marketing Science 5/2019

20.05.2019 | Original Empirical Research

A multi-facet item response theory approach to improve customer satisfaction using online product ratings

verfasst von: Ling Peng, Geng Cui, Yuho Chung, Chunyu Li

Erschienen in: Journal of the Academy of Marketing Science | Ausgabe 5/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

While online platforms often provide a single composite rating and the ratings of different attributes of a product, they largely ignore the attribute characteristics and customer criticality, which limits managerial action. We propose a multi-facet item response theory (MFIRT) approach to simultaneously examine the effects of product attributes, reviewer criticality, consumption situation, product type, and time in assessing latent customer satisfaction. Analyses of hotel ratings from TripAdvisor and beer ratings from BeerAdvocate suggest that product attributes differ with respect to their discriminating and threshold characteristics and that reviewer segments emphasize different attributes when rating various products over time. The MFIRT approach predicts product performance more accurately than alternative methods and provides novel insights to inform marketing strategies. The MFIRT framework can fundamentally advance how we analyze customer satisfaction and other consumer attitudes and improve marketing research and practice.
Vorheriger Artikel Short- and long-term market returns of international codevelopment alliances of new products

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Jetzt informieren
Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
A summary table is included in Web Appendix A for interested readers to compare IRT and CTT in terms of their assumptions, mathematical model, nature of variables, precision of meaurement, and strengths and weaknesses.
 
2
Web Appendix D reports the details of multilevel GRM models. For each specified model, we run 5000 samples and discard them as burn-in. We use 20,000 iterations to generate the sample to estimate the parameters. We derive the attribute weights from the results of Model 2.
 
3
The ML-MFIRT commands implemented using SAS NLMIXED and detailed results are reported in Web Appendix E.
 
4
The reviewers of Tripadvisor are assigned a title (i.e., reviewers withouta title or those who are starting out as reviewers, senior reviewers, contributors, senior contributors, and top contributors) based on their increasing contributions.
 
5
To save space, we do not report the results of response category parameters in Table 4. Interested readers can check the detailed results in Table E1 of Web Appendix E.
 
6
The details of preprocessing and modeling in the text analysis of customer reviews are reported in Web Appendix F.
 
7
The detailed output is presented in Table E2 of Web Appendix E.
 
Literatur
Adams, R. J., Wilson, M., & Wu, M. (1997). Multilevel item response models: An approach to errors in variables regression. Journal of Educational and Behavioral Statistics, 22(1), 47–76.CrossRef
Anderson, C. (2008). The Long Tail: Why the Future of Business is Selling Less of More. New York: Hyperion.
Anderson, E. W., & Mittal, V. (2000). Strengthening the satisfaction-profit chain. Journal of Service Research, 3(2), 107–120.CrossRef
Asparouhov, T., & Muthén, B. (2012). General random effect latent variable modeling: random subjects, items, contexts, and parameters. In J. R. Harring, L. M. Stapleton, & S. N. Beretvas (Eds.), Advances in Multilevel Modeling for Educational Research: Addressing Practical Issues Found in Real-world Applications (pp. 163–192). Charlotte: Information Age Publishing, Inc.
Balasubramanian, S. K., & Kamakura, W. A. (1989). Measuring consumer attitudes toward the marketplace with tailored interviews. Journal of Marketing Research, 26(3), 311–328.CrossRef
Balasubramanian, S. K., Konana, P., & Menon, N. M. (2003). Customer satisfaction in virtual environments: A study of online investing. Management Science, 49(7), 871–889.CrossRef
Bawa, K., Srinivasan, S. S., & Srivastava, R. K. (1997). Coupon attractiveness and coupon proneness: A framework for modeling coupon redemption. Journal of Marketing Research, 34(4), 517–525.CrossRef
Bechtel, G. G. (1985). Generalizing the rasch model for consumer rating scales. Marketing Science, 4(1), 62–73.CrossRef
Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent dirichlet allocation. Journal of Machine Learning Research, 3, 993–1022.
Büschken, J., & Allenby, G. M. (2016). Sentence-based text analysis for customer reviews. Marketing Science, 35(6), 953–975.CrossRef
Cambria, E., & White, B. (2014). Jumping NLP curves: A review of natural language processing research. IEEE Computational Intelligence, 9(2), 48–57.CrossRef
Carenini, G., Cheung, J. C., & Pauls, A. (2013). Multi-document summarization of evaluative text. Computational Intelligence, 29(4), 545–576.CrossRef
Chen, P., Hong, Y., & Liu, Y. (2018). The value of multi-dimensional rating systems: Evidence from a natural experiment and randomized experiments. Management Science, 64(10), 4629–4647.CrossRef
Chevalier, J., & Mayzlin, D. (2006). The effect of word of mouth on sales: Online book reviews. Journal of Marketing Research, 43(3), 345–354.CrossRef
Chou, Y. T., & Wang, W. C. (2010). Checking dimensionality in item response models with principal component analysis on standardized residuals. Educational and Psychological Measurement, 70(5), 717–731.CrossRef
Chung, W., & Tseng, B. (2012). Discovering business intelligence from online product reviews: A rule-induction framework. Expert Systems with Applications, 39, 11870–11879.CrossRef
Clemons, E. K., Gao, G., & Hitt, L. M. (2006). When online reviews meet hyperdifferentiation: A study of the craft beer industry. Journal of Management Information Systems, 23(2), 149–171.CrossRef
Cui, G., Lui, H. K., & Guo, X. (2012). The effect of online consumer reviews on new product sales. International Journal of Electronic Commerce, 17(1), 39–57.CrossRef
de Jong, M., Steenkamp, J. E. M., & Fox, J. (2007). Relaxing measurement invariance in cross-national consumer research using a hierarchical IRT model. Journal of Consumer Research, 34(2), 260–279.CrossRef
de Jong, M., Steenkamp, J. E. M., Fox, J., & Baumgartner, H. (2008). Using item response theory to measure extreme response style in marketing research: A global investigation. Journal of Marketing Research, 45(1), 104–115.CrossRef
de Jong, M., Steenkamp, J. E. M., & Veldkamp, B. P. (2009). A model for the construction of country-specific yet internationally comparable short-form marketing scales. Marketing Science, 28(4), 674–689.CrossRef
de Jong, M., Pieters, R., & Fox, J. (2010). Reducing social desirability bias through item randomized response: An application to measure underreported desires. Journal of Marketing Research, 47(1), 14–27.CrossRef
De Langhe, B., Fernbach, P. M., & Lichtenstein, D. R. (2016). Navigatig by the stars: Investigating the actual and perceived validity of online user ratings. Journal of Consumer Research, 42(6), 817–833.CrossRef
Dellarocas, C. (2003). The digitization of word of mouth: Promise and challenges of online feedback mechanisms. Management Science, 49(10), 1407–1424.CrossRef
Dellarocas, C., Zhang, M. X., & Awad, N. F. (2007). Exploring the value of online product reviews in forecasting sales: The case of motion pictures. Journal of Interactive Marketing, 21(4), 23–45.CrossRef
DeSarbo, W. S., Wedel, M., Vriens, M., & Ramaswamy, V. (1992). Latent class metric conjoint analysis. Marketing Letters, 3(3), 273–288.
Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists, Lawrence.
Ewing, M. T., Salzberger, T., & Sinkovics, R. R. (2005). An alternate approach to assessing cross-cultural measurement equivalence in advertising research. Journal of Advertising Research, 34(1), 17–36.CrossRef
Finn, A., & Kayande, U. (1997). Reliability assessment and optimization of marketing measurement. Journal of Marketing Research, 22(1), 262–275.CrossRef
Finn, A., & Kayande, U. (2005). How fine is COARSE? A generalizability theory perspective on rossiter’s procedure. International Journal of Research in Marketing, 22(1), 11–21.CrossRef
Fishbein, M. (1983). An investigation of the relationships between beliefs about an object and the attitude toward that objec. Human Relations, 16(3), 233–240.CrossRef
Fox, J. (2005). Multilevel IRT using dichotomous and polytomous response data. British Journal of Mathematical and Statistical Psychology, 58(1), 145–172.CrossRef
Fox, J., & Glas, C. A. W. (2001). Bayesian estimation of a multilevel IRT model using Gibbs sampling. Psychometrika, 66, 269–286.CrossRef
Garbarino, E., & Johnson, M. S. (1999). The different roles of satisfaction, trust, and commitment in customer relationships. Journal of Marketing, 63(2), 70–87.CrossRef
Gierl, M. J., & Khaliq, S. N. (2001). Identifying sources of differential item and bundle functioning on translated achievement tests. Journal of Educational Measurement, 38(2), 164–187.CrossRef
Hambleton, R. K., Swaminathan, H., & Rogers, J. H. (1991). Fundamentals of item response theory. Newbury Park, CA: Sage.
Hanson, R. (1992). Determining attribute importance. Quirk’s Marketing Research Review, 6(October), 16–18.
Hennig-Thurau, T., Gwinner, K. P., Walsh, G., & Gremler, D. D. (2004). Electronic word of mouth via consumer-opinion platforms: What motivates consumers to articulate themselves on the internet. Journal of Interactive Marketing, 18(1), 38–52.CrossRef
Holbrook, M. (2005). The role of ordinary evaluations in the market for popular culture: Do consumers have good taste. Marketing Letters, 16(2), 75–86.CrossRef
Holman, R., Glas, C. A. W., & de Haan, R. J. (2003). Power analysis in randomized clinical trials based on item response theory. Controlled Clinical Trials, 24(4), 390–410.CrossRef
Hung, L. F., & Wang, W. C. (2012). The generalized multilevel facets model for longitudinal data. Journal of Educational and Behavioral Statistics, 37(2), 231–255.CrossRef
Kekre, S., Krishnan, M. S., & Srinivasan, K. (1995). Drivers of customer satisfaction for software products: Implications for design and support service. Management Science, 41(9), 1456–1470.CrossRef
Knoll, M. A. Z., & Houts, C. R. (2012). The financial knowledge scale: An application of item response theory to the assessment of financial literacy. Journal of Consumer Affairs, 46(3), 381–410.CrossRef
Koren, Y., Bell, R., & Volinsky, C. (2009). Matrix factorization techniques for recommender systems. Computer, 42(8), 30–37.CrossRef
Lee, K., Lee, B., & Oh, W. (2015). Thumbs up, sales up? The contingent effect of facebook likes on sales performance in social commerce. Journal of Management Information Systems, 32(4), 109–143.CrossRef
Li, X., & Hitt, L. M. (2008). Self-selection and information role of online product reviews. Information Systems Research, 19(4), 456–474.CrossRef
Li, C., Peng, L., & Cui, G. (2017). Picking winners: New product concept testing with the item response theory. International Journal of Market Research, 59(3), 335–354.CrossRef
Linacre, J. M. (1994). Many-facet Rasch measurement. Chicago: MESA Press.
Lord, F. M. (1980). Applications of item response theory to practical testing problems. In Erlbaum. NJ: Hillside.
Mattila, A. S. (1999). The role of culture in the service evaluation process. Journal of Service Research, 1(3), 250–261.CrossRef
Maydeu-Olivares, A. (2013). Goodness-of-fit assessment of item response theory models. Measurement: Interdisciplinary Research and Perspectives, 11(3), 71–101.
Mittal, V., & Kamakura, W. (2001). Satisfaction, repurchase intention, and repurchase behavior: Investigating the moderating effect of customer characteristics. Journal of Marketing Research, 38(1), 131–142.CrossRef
Mittal, V., Ross, W. T., & Baldasare, P. M. (1998). The asymmetric impact of negative and positive attribute-level performance on overall satisfaction and repurchase intentions. Journa of Marketing, 62(1), 33–47.CrossRef
Moe, W. W., & Schweidel, D. A. (2011). Online product opinion: Incidence, evaluations and evolution. Marketing Science, 31(3), 372–386.CrossRef
Moe, W. W., & Trusov, M. (2011). The value of social dynamics in online product ratings forums. Journal of Marketing Research, 48(3), 444–456.CrossRef
Mokkan, R. J., & Lewis, C. (1982). A nonparametric approach to the analysis of dichotomous item responses. Applied Psychological Measurement, 6(4), 417–430.CrossRef
Netzer, O., Feldman, R., Goldenberg, J., & Fresko, M. (2012). Mine your own business: Market-structure surveillance through text mining. Marketing Science, 31(3), 521–543.CrossRef
Ostini, R., & Nering, M. L. (2006). Polytomous item response theory models. Thousand Oaks: Sage.CrossRef
Paas, L., & Sijtsma, K. (2008). Nonparametric item response theory for investigating dimensionality of marketing scales: A SERVQUAL application. Marketing Letters, 19(2), 157–170.CrossRef
Raykov, T., & Calantone, R. J. (2014). The utility of item response modeling in marketing research. Journal of the Academy of Marketing Science, 42(4), 337–360.CrossRef
Reise, S. P., & Waller, N. G. (2009). Item response theory and clinical measurement. Annual Review of Clinical Psychology, 5, 27–48.CrossRef
Rusch, T., Lowry, P., Mair, P., & Treiblmaier, H. (2017). Breaking free from the limitations of classical test theory: Developing and measuring information systems scales using item response theory. Information & Management, 54, 189–203.CrossRef
Samejima, F. (1969). Estimation of a latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement, 34(4), 100–139.
Schultz, C., Salomo, S., & Talke, K. (2013). Measuring new product portfolio innovativeness: How differences in scale width and evaluator perspectives affect its relationship with performance. Journal of Product Innovation Management, 30(S1), 93–109.CrossRef
Singh, J., Howell, R. D., & Rhoads, G. K. (1990). Adaptive designs for likert-type data: An approach for implementing marketing surveys. Journal of Marketing Research, 27(3), 304–321.CrossRef
Smith, D., Menon, S., & Sivakumar, K. (2005). Online peer and editorial recommendations, trust, and choice in virtual markets. Journal of Interactive Marketing, 19(3), 15–37.CrossRef
Srivastava, A., & Sahami, M. (2009). Text mining: Classification, clustering, and Appications, Chapman and Hall.
Swaminathan, S., & Bawa, K. (2005). Category-specific coupon proneness: The impact of individual characteristics and category-specific variables. Journal of Retailing, 81(3), 205–214.CrossRef
Tay, L., Diener, E., Drasgow, F., & Vermunt, J. K. (2011). Multilevel mixed-measurement IRT analysis: An explication and application to self-reported emotions across the world. Organizational Research Methods, 14(1), 177–207.CrossRef
Van den Bulte, C., & Joshi, Y. V. (2007). New product diffusion with influentials and imitators. Marketing Science, 26(3), 400–421.CrossRef
Van den Noortgate, W., De Boeck, P., & Meulders, M. (2003). Cross-classification multilevel logistic models in psychometrics. Journal of Educational and Behavioral Statistics, 28, 369–386.CrossRef
Wang, W. C., & Liu, C. Y. (2007). Formulation and application of the generalized multilevel facets model. Educational and Psychological Measurement, 67(4), 583–605.CrossRef
Xie, K. L., Zhang, Z., & Zhang, Z. (2014). The business value of online consumer reviews and management response to hotel performance. International Journal of Hospitality Management, 43, 1–12.CrossRef
Xu, X., & Li, Y. (2016). The antecedents of customer satisfaction and dissatisfaction toward various types of hotels: A text mining approach. International Journal of Hospitality Management, 55, 57–69.CrossRef
Zwass, V. (2010). Co-creation: Toward a taxonomy and an integrated research perspective. International Journal of Electronic Commerce, 15(1), 11–48.CrossRef
Metadaten
Titel
A multi-facet item response theory approach to improve customer satisfaction using online product ratings
verfasst von
Ling Peng
Geng Cui
Yuho Chung
Chunyu Li
Publikationsdatum
20.05.2019
Verlag
Springer US
Erschienen in
Journal of the Academy of Marketing Science / Ausgabe 5/2019
Print ISSN: 0092-0703
Elektronische ISSN: 1552-7824
DOI
https://doi.org/10.1007/s11747-019-00662-w

Weitere Artikel der Ausgabe 5/2019

Journal of the Academy of Marketing Science 5/2019 Zur Ausgabe

Original Empirical Research

When it pays to have a friend on the inside: contingent effects of buyer advocacy on B2B suppliers

Original Empirical Research

Effects of dominance transitions on advice adherence in professional service conversations

Original Empirical Research

Improving customer profit predictions with customer mindset metrics through multiple overimputation

Original Empirical Research

When pushing back is good: the effectiveness of brand responses to social media complaints

Original Empirical Research

Employee satisfaction trajectories and their effect on customer satisfaction and repatronage intentions

Original Empirical Research

The effect of cause-related marketing on firm value: a look at Fortune’s most admired all-stars