ABSTRACT
Usability of security solution has always been a keen area of interest for researchers. CAPTCHA is one such security solution which presents various usability challenges for users. However, it has successfully reduced the abuse of the Internet resources, such as spam. Similar to the Internet, audio-based CAPTCHAs have been proposed as a solution to curb voice spam over telephony. Voice spam is often encountered on telephony in various forms, such as, an automated telemarketing call asking to call a number to win million of dollars. A large percentage of voice spam is generated through automated system which introduces the classical challenge of distinguishing machines from humans on the telephony. We present a large scale evaluation of audio CAPTCHA from the human perspective over telephony through a field study with 90 participants. We study two primary research questions: how much inconvenience does audio CAPTCHA causes to users on telephony, and how different features of the CAPTCHA, e.g., duration and size influence usability of audio CAPTCHA on telephony. We found that captcha could be a viable solution for telephony with improved features, such as better voice and accent. We found that users were relatively close to the expected correct answers, which does suggest the possibility of deploying audio captcha on telephony platforms in the future. However, we did not find strong influence of captcha size and duration on solving accuracy.
- FTC Robocalls Challenge, 2012, http://robocall.challenge.gov/submissions/.Google Scholar
- Balasubramaniyan, V., Poonawalla, A., Ahamad, M., Hunter, M. T., and Traynor, P. PinDr0p: Using Single-Ended Audio Features To Determine Call Provenance. CCS (2010). Google ScholarDigital Library
- Bigham, J. P., and Cavender, A. C. Evaluating Existing Audio CAPTCHAs and an Interface Optimized for Non-Visual Use.Google Scholar
- Bonneau, D. G., and Blanchard, H. E. E. Human Factors and Voice Interactive Systems. Springer, 2008.Google Scholar
- Bradley, J. Complete counterbalancing of immediate sequential effects in a latin square design. Journal of the American Statistical Association 53, 282 (1958), 525--528.Google Scholar
- Bursztein, E., Bethard, S., Fabry, C., Mitchell, J., and Jurafsky, D. How Good Are Humans at Solving CAPTCHAs? A Large Scale Evaluation. SP '10, 399--413. Google ScholarDigital Library
- Cooper, G. Research into cognitive load theory and instructional design at UNSW. http://webmedia.unmc.edu/leis/birk/CooperCogLoad.pdf. 1998.Google Scholar
- Cranor, Lorrie Faith. A framework for reasoning about the human in the loop. In UPSEC (2008). Google ScholarDigital Library
- International Telecommunication Union. Measuring the information Society, http://www.itu.int/ITU-D/ict/publications/idi/material/2012/MIS2012_without_Annex_4.pdf.Google Scholar
- Johansen, A. J. Improvement of spit prevention technique based on turing test. Master's thesis, Mahanakorn University of Technology.Google Scholar
- Polakis, I., Kontaxis, G., and Ioannidis, S. CAPTCHuring Automated (Smart) Phone Attacks. In SYSSEC (2011), 27--34. Google ScholarDigital Library
- Quittek, J., Niccolini, S., Tartarelli, S., Stiemerling, M., Brunner, M., and Ewald, T. Detecting spit calls by checking human communication patterns. ICC (2007).Google Scholar
- von Ahn, L., Blum, M., and Langford, J. Telling Humans and Computers Apart (Automatically) or How Lazy Cryptographers Do AI. CACM (2004), 56--60. Google ScholarDigital Library
Index Terms
- On the viability of CAPTCHAs for use in telephony systems: a usability field study
Recommendations
Usability of CAPTCHAs or usability issues in CAPTCHA design
SOUPS '08: Proceedings of the 4th symposium on Usable privacy and securityCAPTCHA is now almost a standard security technology, and has found widespread application in commercial websites. Usability and robustness are two fundamental issues with CAPTCHA, and they often interconnect with each other. This paper discusses ...
On the Viability of CAPTCHAs for use in Telephony Systems: A Usability Field Study
ISC 2013: Proceedings of the 16th International Conference on Information Security - Volume 7807Telephony systems are imperative for information exchange offering low cost services and reachability to millions of customers. They have not only benefited legitimate users but have also opened up a convenient communication medium for spammers. Voice ...
Development of two novel face-recognition CAPTCHAs
CAPTCHAs are challenge-response tests that aim at preventing unwanted machines, including bots, from accessing web services while providing easy access for humans. Recent advances in artificial-intelligence based attacks show that the level of security ...
Comments