Adam Janin
Gerald Friedland
ABSTRACT
Joke-o-mat HD is a system that allows a user to navigate sitcoms (such as Seinfeld) by "narrative themes", including scenes, punchlines, and dialog segments. The themes can be filtered by the main actors and by keyword. For example, the user can select to see only punchlines by Kramer that contain the word "armoire". The system infers the narrative themes using segmentation of the audio track into laughter, actors, words, and music. The segmentation can be generated either by an expert annotator, via automatic methods, or by exploiting human derived (HD) "found" data such as fan-generated scripts and closed captions. We demonstrate browsing one episode of Seinfeld using all three methods of generating segmentations.
- G. Friedland, L. Gottlieb, and A. Janin. Joke-o-mat: Browsing sticoms punchline-by-punchline. In Proceedings of ACM Multimedia, pages pp. 1115--1116. ACM, October 2009. Google Scholar
Digital Library
- G. Friedland, L. Gottlieb, and A. Janin. Using artistic markers and speaker identification for narrative-theme navigation of seinfeld episodes. In Proceedings of the 11th IEEE International Symposium on Multimedia, pages pp. 511--516, December 2009. Google ScholarDigital Library
- G. Friedland and O. Vinyals. Live speaker identification in conversations. In Proceedings of ACM Multimedia, pages 1017--1018. ACM, October 2008. Google ScholarDigital Library
- G. Friedland, C. Yeo, and H. Hung. Visual speaker localization aided by acoustic models. In Proceedings of ACM Multimedia, pages 195--202. ACM, October 2009. Google ScholarDigital Library
- A. Stolcke, X. Anguera, K. Boakye, O. Cetin, A. Janin, M. Magimai-Doss, C. Wooters, and J. Zheng. The SRI-ICSI Spring 2007 Meeting and Lecture Recognition System. Multimodal Technologies for Perception of Humans, Lecture Notes in Computer Science, pages 450--463, 2008. Google ScholarDigital Library
Index Terms
- Joke-o-Mat HD: browsing sitcoms with human derived transcripts
Recommendations
Joke-o-mat: browsing sitcoms punchline by punchline
MM '09: Proceedings of the 17th ACM international conference on MultimediaThis paper summarizes our contribution to the Yahoo! task of the ACM Multimedia Grand Challenge. This challenge asks for the robust automatic segmentation of videos according to "narrative themes". Based on the automatic segmentation methods presented ...
Time warp football
EuroITV '09: Proceedings of the 7th European Conference on Interactive TV and VideoWe describe a system called Time Warp Football (TWF) which puts fans in control of the game watching experience. TWF uses annotated video streams to enable instantaneous forward and backward play-by-play navigation and on-demand switching between ...
Conversational Agents Replying with a Manzai-style Joke
OzCHI '21: Proceedings of the 33rd Australian Conference on Human-Computer InteractionAutomated conversational agents are becoming popular in various everyday contexts. In order to fulfill a more important role in human society, people would need to feel a sense of familiarity with such agents. To achieve this, we focus on humor, which ...
Comments