Skip to main content
main-content
Top

Hint

Swipe to navigate through the chapters of this book

2019 | OriginalPaper | Chapter

A User Modeling Shared Challenge Proposal

Authors: Owen Conlan, Kieran Fraser, Liadh Kelly, Bilal Yousuf

Published in: Experimental IR Meets Multilinguality, Multimodality, and Interaction

Publisher: Springer International Publishing

share
SHARE

Abstract

Comparative evaluation in the areas of User Modeling, Adaptation and Personalization (UMAP) is significantly challenging. It has always been difficult to rigorously compare different approaches to personalization, as the function of the resulting systems is, by their nature, heavily influenced by the behavior of the users involved in trialing the systems. Developing comparative evaluations in this space would be a huge advancement as it would enable shared comparison across research. Here we present a proposal for a shared challenge generation in UMAP, focusing on user model generation using logged mobile phone data, with an assumed purpose of supporting mobile phone notification suggestion. The dataset, evaluation metrics, and challenge operation are described.
Literature
1.
go back to reference Conlan, O., Kelly, L., Koidl, K., Lawless, S., Levacher, K., Staikopoulos, A.: EvalUMAP 2016: towards comparative evaluation in the user modelling, adaptation and personalization space workshop. In: UMAP 2016 (2016) Conlan, O., Kelly, L., Koidl, K., Lawless, S., Levacher, K., Staikopoulos, A.: EvalUMAP 2016: towards comparative evaluation in the user modelling, adaptation and personalization space workshop. In: UMAP 2016 (2016)
2.
go back to reference Conlan, O., Kelly, L., Koidl, K., Lawless, S., Staikopoulos, A.: EvalUMAP 2017: towards comparative evaluation in the user modelling, adaptation and personalization space workshop. In: UMAP 2017 (2017) Conlan, O., Kelly, L., Koidl, K., Lawless, S., Staikopoulos, A.: EvalUMAP 2017: towards comparative evaluation in the user modelling, adaptation and personalization space workshop. In: UMAP 2017 (2017)
3.
go back to reference Fehr, J., Heiland, J., Himpe, C., Saak, J.: Best practices for replicability, reproducibility and reusability of computer-based experiments exemplified by model reduction software. arXiv preprint arXiv:​1607.​01191 (2016) Fehr, J., Heiland, J., Himpe, C., Saak, J.: Best practices for replicability, reproducibility and reusability of computer-based experiments exemplified by model reduction software. arXiv preprint arXiv:​1607.​01191 (2016)
4.
go back to reference Fraser, K., Yousuf, B., Conlan, O.: Synthesis and evaluation of a mobile notification dataset. In: Adjunct Publication of UMAP 2017 (2017) Fraser, K., Yousuf, B., Conlan, O.: Synthesis and evaluation of a mobile notification dataset. In: Adjunct Publication of UMAP 2017 (2017)
7.
go back to reference Hui Yang, G., Soboroff, I.: TREC 2016 dynamic domain track overview. In: TREC 2016 (2016) Hui Yang, G., Soboroff, I.: TREC 2016 dynamic domain track overview. In: TREC 2016 (2016)
Metadata
Title
A User Modeling Shared Challenge Proposal
Authors
Owen Conlan
Kieran Fraser
Liadh Kelly
Bilal Yousuf
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-28577-7_13

Premium Partner