skip to main content
10.1145/2525194.2525265acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

On the viability of CAPTCHAs for use in telephony systems: a usability field study

Published:24 September 2013Publication History

ABSTRACT

Usability of security solution has always been a keen area of interest for researchers. CAPTCHA is one such security solution which presents various usability challenges for users. However, it has successfully reduced the abuse of the Internet resources, such as spam. Similar to the Internet, audio-based CAPTCHAs have been proposed as a solution to curb voice spam over telephony. Voice spam is often encountered on telephony in various forms, such as, an automated telemarketing call asking to call a number to win million of dollars. A large percentage of voice spam is generated through automated system which introduces the classical challenge of distinguishing machines from humans on the telephony. We present a large scale evaluation of audio CAPTCHA from the human perspective over telephony through a field study with 90 participants. We study two primary research questions: how much inconvenience does audio CAPTCHA causes to users on telephony, and how different features of the CAPTCHA, e.g., duration and size influence usability of audio CAPTCHA on telephony. We found that captcha could be a viable solution for telephony with improved features, such as better voice and accent. We found that users were relatively close to the expected correct answers, which does suggest the possibility of deploying audio captcha on telephony platforms in the future. However, we did not find strong influence of captcha size and duration on solving accuracy.

References

  1. FTC Robocalls Challenge, 2012, http://robocall.challenge.gov/submissions/.Google ScholarGoogle Scholar
  2. Balasubramaniyan, V., Poonawalla, A., Ahamad, M., Hunter, M. T., and Traynor, P. PinDr0p: Using Single-Ended Audio Features To Determine Call Provenance. CCS (2010). Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Bigham, J. P., and Cavender, A. C. Evaluating Existing Audio CAPTCHAs and an Interface Optimized for Non-Visual Use.Google ScholarGoogle Scholar
  4. Bonneau, D. G., and Blanchard, H. E. E. Human Factors and Voice Interactive Systems. Springer, 2008.Google ScholarGoogle Scholar
  5. Bradley, J. Complete counterbalancing of immediate sequential effects in a latin square design. Journal of the American Statistical Association 53, 282 (1958), 525--528.Google ScholarGoogle Scholar
  6. Bursztein, E., Bethard, S., Fabry, C., Mitchell, J., and Jurafsky, D. How Good Are Humans at Solving CAPTCHAs? A Large Scale Evaluation. SP '10, 399--413. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Cooper, G. Research into cognitive load theory and instructional design at UNSW. http://webmedia.unmc.edu/leis/birk/CooperCogLoad.pdf. 1998.Google ScholarGoogle Scholar
  8. Cranor, Lorrie Faith. A framework for reasoning about the human in the loop. In UPSEC (2008). Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. International Telecommunication Union. Measuring the information Society, http://www.itu.int/ITU-D/ict/publications/idi/material/2012/MIS2012_without_Annex_4.pdf.Google ScholarGoogle Scholar
  10. Johansen, A. J. Improvement of spit prevention technique based on turing test. Master's thesis, Mahanakorn University of Technology.Google ScholarGoogle Scholar
  11. Polakis, I., Kontaxis, G., and Ioannidis, S. CAPTCHuring Automated (Smart) Phone Attacks. In SYSSEC (2011), 27--34. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Quittek, J., Niccolini, S., Tartarelli, S., Stiemerling, M., Brunner, M., and Ewald, T. Detecting spit calls by checking human communication patterns. ICC (2007).Google ScholarGoogle Scholar
  13. von Ahn, L., Blum, M., and Langford, J. Telling Humans and Computers Apart (Automatically) or How Lazy Cryptographers Do AI. CACM (2004), 56--60. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. On the viability of CAPTCHAs for use in telephony systems: a usability field study

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      APCHI '13: Proceedings of the 11th Asia Pacific Conference on Computer Human Interaction
      September 2013
      420 pages
      ISBN:9781450322539
      DOI:10.1145/2525194

      Copyright © 2013 Owner/Author

      Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 24 September 2013

      Check for updates

      Qualifiers

      • research-article

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader