ABSTRACT
Previous studies investigating task based search often take the form of lab studies or large scale log analysis. In lab studies, users typically perform a designed task under a controlled environment, which may not reflect their natural behaviour. While log analysis allows the observation of users' natural search behaviour, often strong assumptions need to be made in order to associate the unobserved underlying user tasks with log signals.
We describe a field study during which we log participants' daily search and browsing activities for 5 days, and users are asked to self-annotate their search logs with the tasks they conducted as well as to describe the task characteristics according to a conceptual task classification scheme. This provides us with a more realistic and comprehensive view on how user tasks are associated with logged interactions than seen in previous log- or lab-based studies; and allows us to explore the complex interactions between task characteristics and their presence in naturalistic tasks which has not been studied previously.
We find a higher number of queries, longer timespan, as well as more task switches than reported in previous log based studies; and 41% of our tasks are zero-query tasks implying that large amounts of user task activities remain unobserved when only focused on query logs. Further, tasks sharing similar descriptions can vary greatly in their characteristics, suggesting that when supporting users with their tasks, it is important to know not only the task they are engaged with but also the context of the user in the task.
- A. Aula, R. M. Khan, and Z. Guan. How does search behavior change as search becomes more difficult? In SIGCHI'10, pages 35--44. ACM, 2010. Google ScholarDigital Library
- A. H. Awadallah, R. W. White, P. Pantel, S. T. Dumais, and Y.-M. Wang. Supporting complex search tasks. In CIKM'14, pages 1--10, 2014.Google ScholarDigital Library
- A. Broder. A taxonomy of web search. In ACM Sigir forum, volume 36, pages 3--10. ACM, 2002. Google ScholarDigital Library
- M. Bron, J. Van Gorp, F. Nack, L. B. Baltussen, and M. de Rijke. Aggregated search interface preferences in multi-session search tasks. In SIGIR'13, pages 123--132. ACM, 2013. Google ScholarDigital Library
- K. Byström and P. Hansen. Conceptual framework for tasks in information studies. JASIST, 56 (10): 1050--1061, 2005. Google ScholarDigital Library
- K. Byström and K. Järvelin. Task complexity affects information seeking and use. IP&M, 31 (2): 191--213, 1995. Google ScholarDigital Library
- K. Church, M. Cherubini, and N. Oliver. A large-scale study of daily information needs captured in situ. ACM TOCHI, 21 (2): 10, 2014. Google ScholarDigital Library
- S. Dumais. Task-based search: a search engine perspective. In NSF Workshop on Task-Based Search, page 1, 2013.Google Scholar
- C. Eickhoff, J. Teevan, R. White, and S. Dumais. Lessons from the journey: a query log analysis of within-session learning. In WSDM'14, pages 223--232. ACM, 2014. Google ScholarDigital Library
- B. J. Frey and D. Dueck. Clustering by passing messages between data points. science, 315 (5814): 972--976, 2007.Google Scholar
- E. Greifeneder. The effects of distraction on task completion scores in a natural environment test setting. JASIST, 2015. Google ScholarDigital Library
- J. Gwizdka and I. Spence. What can searching behavior tell us about the difficulty of information tasks. A study of Web navigation. ASIST, 6, 2006.Google Scholar
- M. Hagen, J. Gomoll, A. Beyer, and B. Stein. From search session detection to search mission detection. In OAIR'13, pages 85--92, 2013. Google ScholarDigital Library
- J. He, M. Bron, and A. P. de Vries. Characterizing stages of a multi-session complex search task through direct and indirect query modifications. In SIGIR'13, pages 897--900. ACM, 2013. Google ScholarDigital Library
- K. Järvelin and P. Ingwersen. Information seeking research needs extension towards tasks and technology. Information Research, 10 (1), 2004.Google Scholar
- R. Jones and K. L. Klinkner. Beyond the session timeout: automatic hierarchical segmentation of search topics in query logs. In CIKM'08, pages 699--708. ACM, 2008. Google ScholarDigital Library
- M. Kellar, C. Watters, and M. Shepherd. A field study characterizing web-based information-seeking tasks. JASIST, 58 (7): 999--1018, 2007. Google ScholarDigital Library
- D. Kelly and N. J. Belkin. Display time as implicit feedback: understanding task effects. In SIGIR'04, pages 377--384. ACM, 2004. Google ScholarDigital Library
- D. Kelly, J. Arguello, A. Edwards, and W.-c. Wu. Development and evaluation of search tasks for iir experiments using a cognitive complexity framework. In ICTIR'15, pages 101--110. ACM, 2015. Google ScholarDigital Library
- A. Kotov, P. N. Bennett, R. W. White, S. T. Dumais, and J. Teevan. Modeling and analysis of cross-session search tasks. In SIGIR'11, pages 5--14. ACM, 2011. Google ScholarDigital Library
- L. Li, H. Deng, A. Dong, Y. Chang, and H. Zha. Identifying and labeling search tasks via query-based hawkes processes. In SIGKDD'14, pages 731--740. ACM, 2014. Google ScholarDigital Library
- Y. Li and N. J. Belkin. A faceted approach to conceptualizing tasks in information seeking. IP&M, 44 (6): 1822--1837, 2008. Google ScholarDigital Library
- J. Liu, M. J. Cole, C. Liu, R. Bierig, J. Gwizdka, N. J. Belkin, J. Zhang, and X. Zhang. Search behaviors in different task types. In JCDL'10, pages 69--78. ACM, 2010. Google ScholarDigital Library
- C. Lucchese, S. Orlando, R. Perego, F. Silvestri, and G. Tolomei. Identifying task-based sessions in search engine query logs. In WSDM'11, pages 277--286. ACM, 2011. Google ScholarDigital Library
- D. Odijk, R. W. White, A. Hassan Awadallah, and S. T. Dumais. Struggling and success in web search. In CIKM'15, pages 1551--1560. ACM, 2015. Google ScholarDigital Library
- D. M. Russell, D. Tang, M. Kellar, and R. Jeffries. Task behaviors during web search: The difficulty of assigning labels. In System Sciences, 2009. HICSS'09., pages 1--5. IEEE, 2009. Google ScholarDigital Library
- C. L. Smith. Conditions of trust for completely-remote methods: A proposal for collaboration. In HCIR, 2012.Google Scholar
- A. Spink, M. Park, B. J. Jansen, and J. Pedersen. Multitasking during web search sessions. IP&M, 42 (1): 264--275, 2006. Google ScholarDigital Library
- P. Vakkari. Task-based information searching. Annual review of information science and technology, 37 (1): 413--464, 2003.Google Scholar
- P. Vakkari, M. Pennanen, and S. Serola. Changes of search terms and tactics while writing a research proposal: A longitudinal case study. IP&M, 39 (3): 445--463, 2003. Google ScholarDigital Library
- R. W. White and D. Kelly. A study on the effects of personalization and task information on implicit feedback performance. In CIKM'06, pages 297--306. ACM, 2006. Google ScholarDigital Library
- G. Zuccon, T. Leelanupab, S. Whiting, E. Yilmaz, J. M. Jose, and L. Azzopardi. Crowdsourcing interactions: using crowd sourcing for evaluating interactive information retrieval systems. Information retrieval, 16 (2): 267--305, 2013. Google ScholarDigital Library
Index Terms
- User Behaviour and Task Characteristics: A Field Study of Daily Information Behaviour
Recommendations
Understanding Mobile Search Task Relevance and User Behaviour in Context
CHIIR '19: Proceedings of the 2019 Conference on Human Information Interaction and RetrievalImprovements in mobile technologies have led to a dramatic change in how and when people access and use information, and is having a profound impact on how users address their daily information needs. Smart phones are rapidly becoming our main method of ...
Information Search Processes in Complex Tasks
CHIIR '18: Proceedings of the 2018 Conference on Human Information Interaction & RetrievalOur understanding of search processes triggered by complex tasks are limited [1]. It is not well known how does the information search process evolve during task performance and how search behavior varies by task process. How do changes in in ...
Exploring search task difficulty reasons in different task types and user knowledge groups
Development of a search task difficulty reason scheme.Relationship between task difficulty and task type: common and different reasons across task types.Relationship between task difficulty and user knowledge: common and different reasons among ...
Comments