Abstract
Airport patrons answered a self-administered questionnaire regarding their satisfaction with various airport facilities and operations. The questionnaire was administered either by a computer touch-sensitive screen or by a contextually identical paper-and-pencil version. For the latter method, respondents were selected randomly, and for the former, they were either randomly selected or self-selected. The effect of the method of questionnaire administration on the rating scales was very small when the samples were selected at random. However, there were substantial differences in ratings between self-selected and randomly selected respondents: The former gave consistently more negative ratings. These differences are probably due to psychological factors such as motivation to participate. Also, it was found that self-selected persons using the computer were more likely to make comments. The findings of this study are discussed with emphasis on their implications for computer interactive surveys.
Article PDF
Similar content being viewed by others
References
Anderson, A. B., Basilevsky, A., &Hum, D. P. J. (1983). Missing data: A review of the literature. In P. H. Rossi, J. D. Wright, & A. B. Anderson (Eds.),Handbook of survey research (pp. 415–494). Orlando, FL: Academic Press.
Bartram, D., &Bayliss, R. (1984). Automated testing: Past, present and future.Journal of Occupational Psychology,57, 221–237.
Bemelmans-Spork, M. E. J., Keller, W., &Sikkel, D. (1985). Use of handheld microcomputers in the Netherlands Central Bureau of Statistics. InBureau of the Census First Annual Research Conference: Proceedings (pp. 47–52). Reston, VA: Bureau of the Census.
Booth-Kewley, S., Edwards, J. E., &Rosenfeld, P. (1992). Impression management, social desirability, and computer administration of attitude questionnaires: Does the computer make a difference?Journal of Applied Psychology,77, 562–566.
Burke, M. J., &Normand, J. (1987). Computerized psychological testing: Overview and critique.Professional Psychology: Research & Practice,18, 42–51.
Catlin, G., &Ingram, S. (1988). The effects of CATI on costs and data quality: A comparison of CATI and paper methods in centralized interviewing. In R. M. Groves, P. R. Biemer, L. E. Lyberg, J. T. Massey, W. L. Nicholls, & J. Waksberg (Eds.),Telephone survey methodology (pp. 437–450). New York: Wiley.
Couper, M., Groves, R. M., &Jacobs, C. A. (1990). Building predictive models of CAPI acceptance in a field interviewing staff. InBureau of the Census 1990 Annual Research Conference: Proceedings (pp. 685–702). Arlington, VA: Bureau of the Census.
de Bie, S. E., Stoop, I. A. L., &de Vries, K. L. M. (1989).CAI software: An evaluation of software for computer assisted interviewing. Amsterdam: VOI Association of Social Research Institutes.
Department of Business, Economic Development & Tourism (1993).The State of Hawaii Data Book 1992. Honolulu: Author.
Erdman, H. [P.], Klein, M. H., &Greist, J. H. (1983). The reliability of a computer interview for drug use/abuse information.Behavior Research Methods & Instrumentation,15, 66–68.
Erdman, H. P., Klein, M. H., &Greist, J. H. (1985). Direct patient computer interviewing.Journal of Consulting & Clinical Psychology,53, 760–773.
Fink, J. C. (1983). CATI’s first decade: The Chilton experience.Sociological Methods & Research,12, 153–168.
Frey, J. H. (1983).Survey research by telephone. Beverly Hills, CA: Sage.
Greist, J. H., &Klein, M. H. (1980). Computer programs for patients, clinicians, and researchers in psychiatry. In J. P. Sidowski, J. H. Johnson, & T. A. Williams (Eds.),Technology in mental health care delivery systems (pp. 161–181). Norwood, NJ: Ablex.
Groves, R. M. (1983). Implications of CATI: Costs, errors, and organization of telephone survey research.Sociological Methods & Research,12, 199–215.
Groves, R. M., &Nicholls, W. L., II. (1986). The status of computer-assisted telephone interviewing: Part II—Data quality issues.Journal of Official Statistics,2, 117–134.
Kiesler, S., &Sproull, L. S. (1986). Response effects in the electronic survey.Public Opinion Quarterly,50, 402–413.
Lautenschlager, G. J., &Flaherty, V. L. (1990). Computer administration of questions: More desirable or more social desirability?Journal of Applied Psychology,75, 310–314.
Liefeld, J. P. (1987). Computer interviewing: Cursor and response task effects.Canadian Journal of Marketing Research,6 (Nov.), 20–25.
Liefeld, J. P. (1988). Response effects in computer-administered questioning.Journal of Marketing Research,25, 405–409.
Lyberg, L. (1985). Plans for computer-assisted data collection at Statistics Sweden. InProceedings of the 45th Session, International Statistical Institute (Book 3, Topic 18.2, pp. 1–11). Amsterdam: International Statistical Institute.
Martin, C. L., &Nagao, D. H. (1989). Some effects of computerized interviewing on job applicant responses.Journal of Applied Psychology,74, 72–80.
Nicholls, W. L., II, &Groves, R. M. (1986). The status of computer-assisted telephone interviewing: Part I—Introduction and impact on cost and timeliness of survey data.Journal of Official Statistics,2, 93–115.
Rosenfeld, P., Doherty, L. M., Vicino, S. M., Kantor, J., &Greaves, J. (1989). Attitude assessment in organizations: Testing three microcomputer-based survey systems.Journal of General Psychology,116, 145–154.
Saris, W. E. (1991).Computer-assisted interviewing. Newbury Park, CA: Sage.
Shanks, J. M. (1983). The current status of computer-assisted telephone interviewing: Recent progress and future prospects.Sociological Methods & Research,12, 119–142.
Shanks, J. M., &Tortora, R. D. (1985). Beyond CATI: Generalized and distributed systems for computer-assisted surveys. InBureau of the Census First Annual Research Conference: Proceedings (pp. 358–371). Reston, VA: Bureau of the Census.
Skinner, H. A., &Allen, B. A. (1983). Does the computer make a difference? Computerized versus face-to-face self-report assessment of alcohol, drug, and tobacco use.Journal of Consulting & Clinical Psychology,51, 267–275.
Synodinos, N. E., &Brennan, J. M. (1988). Computer interactive interviewing in survey research.Psychology & Marketing,5, 117–137.
Synodinos, N. E., &Brennan, J. M. (1990). Evaluating microcomputer interactive survey software.Journal of Business & Psychology,4, 483–493.
Synodinos, N. E., Papacostas, C. S., &Okimoto, G. M. (1989).Evaluation of computer interactive data collection at the Honolulu International Airport. Project report prepared for the State of Hawaii Department of Transportation, Honolulu.
Tanur, J. M. (1985). Survey research methods in environmental psychology. In A. Baum & J. E. Singer (Eds.),Advances in environmental psychology: Vol. 5. Methods and environmental psychology (pp. 147–184). Hillsdale, NJ: Erlbaum.
Tortora, R. D. (1985). CATI in an agricultural statistical agency.Journal of Official Statistics,1, 301–314.
Vasu, M. L., &Garson, G. D. (1990). Computer-assisted survey research and continuous audience response technology for the political and social sciences.Social Science Computer Review,8, 535–557.
Walsh, J. P., Kiesler, S., Sproull, L. S., &Hesse, B. W. (1992). Selfselected and randomly selected respondents in a computer network survey.Public Opinion Quarterly,56, 241–244.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was conducted under Contract 23181 from the State of Hawaii, Department of Transportation. Opinions expressed herein are those of the authors and do not reflect an official position of the State of Hawaii Department of Transportation or the University of Hawaii. The authors wish to express their appreciation to Chuck Fisher of Magnus Communications Design, Inc., and to Myra Tamanaha of the State of Hawaii Department of Transportation.
Rights and permissions
About this article
Cite this article
Synodinos, N.E., Papacostas, C.S. & Okimoto, G.M. Computer-administered versus paper-and-pencil surveys and the effect of sample selection. Behavior Research Methods, Instruments, & Computers 26, 395–401 (1994). https://doi.org/10.3758/BF03204655
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03204655