Generating Cartoon-Style Summary of Daily Life with Multimedia Mobile Devices

Mobile devices are treasure boxes of personal information containing user’s context, personal schedule, diary, short messages, photos, and videos. Also, user’s usage information on Smartphone can be recorded on the device and they can be used as useful sources of high-level inference. Furthermore, stored multimedia contents can be also regarded as relevant evidences for inferring user’s daily life. Without user’s consciousness, the device continuously collects information and it can be used as an extended memory of human users. However, the amount of information collected is extremely huge and it is difficult to extract useful information manually from the raw data. In this paper, AniDiary (Anywhere Diary) is proposed to summarize user’s daily life in a form of cartoon-style diary. Because it is not efficient to show all events in a day, selected landmark events (memorable events) are automatically converted to the cartoon images. The identification of landmark events is done by modeling causal-effect relationships among various events with a number of Bayesian networks. Experimental results on synthetic data showed that the proposed system provides an efficient and user-friendly way to summarize user’s daily life.