nach oben

Discover Computing

Erschienen in:

01.04.2016 | Medical Information Retrieval

How users search and what they search for in the medical domain

Understanding laypeople and experts through query logs

verfasst von: João Palotti, Allan Hanbury, Henning Müller, Charles E. Kahn Jr.

Erschienen in: Discover Computing | Ausgabe 1-2/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

The internet is an important source of medical knowledge for everyone, from laypeople to medical professionals. We investigate how these two extremes, in terms of user groups, have distinct needs and exhibit significantly different search behaviour. We make use of query logs in order to study various aspects of these two kinds of users. The logs from America Online, Health on the Net, Turning Research Into Practice and American Roentgen Ray Society (ARRS) GoldMiner were divided into three sets: (1) laypeople, (2) medical professionals (such as physicians or nurses) searching for health content and (3) users not seeking health advice. Several analyses are made focusing on discovering how users search and what they are most interested in. One possible outcome of our analysis is a classifier to infer user expertise, which was built. We show the results and analyse the feature set used to infer expertise. We conclude that medical experts are more persistent, interacting more with the search engine. Also, our study reveals that, conversely to what is stated in much of the literature, the main focus of users, both laypeople and professionals, is on disease rather than symptoms. The results of this article, especially through the classifier built, could be used to detect specific user groups and then adapt search results to the user group.

Vorheriger Artikel Methods for linking EHR notes to education materials

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

http://metamap.nlm.nih.gov/.

https://github.com/joaopalotti/logAnalysisJournal.

MedlinePlus is a web-based consumer health information system developed by the American National Library of Medicine (NLM): http://www.medlineplus.gov/.

http://dl.acm.org/.

http://stackoverflow.com/.

Obtained from http://www.gregsadetsky.com/aol-data/.

http://www.hon.ch/HONsearch/Patients/index.html.

http://www.dmoz.org/.

http://www.tripdatabase.com/.

http://goldminer.arrs.org.

A complete list of all semantic types can be found online: http://metamap.nlm.nih.gov/SemanticTypesAndGroups.shtml.

The Random Forest classifier is based on the python machine learning module scikit-learn (http://scikit-learn.org/) Hyper-parameters were optimised using a grid-search approach.

Aronson, A. R. (2001). Effective mapping of biomedical text to the UMLS Metathesaurus: The MetaMap program (pp. 17–21).

Aronson, A. R., & Rindflesch, T. C. (1997). Query expansion using the UMLS Metathesaurus. In Proceedings of the AMIA annual symposium (pp. 485–489).

Aronson, A. R., Bodenreider, O., Chang, H. F., Humphrey, S. M., Mork, J. G., Nelson, S. J., Rindflesch, T. C., & Wilbur, W. J. (2000). The NLM Indexing Initiative (pp. 17–21), Lister Hill National Center for Biomedical Communications (LHNCBC), National Library of Medicine, Bethesda, MD 20894, USA.

Aronson, A. R., & Lang, F. (2010). An overview of metamap: Historical perspective and recent advances. JAMIA, 17(3), 229–236.

Bhavnani, S. K. (2002). Domain-specific search strategies for the effective retrieval of healthcare and shopping information. In CHI ’02 extended abstracts on human factors in computing systems (pp. 610–611), CHI EA ’02. ACM.

Boyer, C., Baujard, V., & Geissbuhler, A. (2011). Evolution of Health Web certification through the HONcode experience. Studies in Health Technology and Informatics, 169, 53–57.

Brenes, D. J., & Gayo-Avello, D. (2009). Stratified analysis of AOL query log. Information Sciences, 179(12), 1844–1858.CrossRef

Cartright, M.-A., White, R. W., & Horvitz, E. (2011). Intentions and attention in exploratory health search. In Proceedings of the 34th international ACM SIGIR conference on research and development in information retrieval (pp. 65–74), SIGIR ’11, New York, NY, USA, ACM.

Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). London: Routledge.MATH

Cole, M. J., Gwizdka, J., Liu, C., Belkin, N. J., & Zhang, X. (2013). Inferring user knowledge level from eye movement patterns. Information Processing and Management, 49(5), 1075–1091.CrossRef

Collins-Thompson, K., Bennett, P. N., White, R. W., de la Chica, S., & Sontag, D. (2011). Personalizing web search results by reading level. In Proceedings of the 20th ACM international conference on information and knowledge management (pp. 403–412), CIKM ’11, New York, NY, USA, ACM.

Demner-Fushman, D., Humphrey, S. M., Ide, N. C., Loane, R. F., Mork, J. G., Ruch, P., Ruiz, M. E., Smith, L. H., Wilbur, W. J., & Aronson, A. R. (2007). Combining resources to find answers to biomedical questions. In Proceedings of the sixteenth text retrieval conference, TREC 2007, Gaithersburg, Maryland, USA, November 5–9, 2007.

Denny, J. C., Smithers, J. D., Miller, R. A., & Spickard, A. (2003). “Understanding” medical school curriculum content using KnowledgeMap. Journal of the American Medical Informatics Association, 10(4), 351–362.CrossRef

Duarte Torres, S., Hiemstra, D., & Serdyukov, P. (2010). Query log analysis in the context of information retrieval for children. In Proceeding of the 33rd international ACM SIGIR conference on research and development in information retrieval (pp. 847–848), New York, ACM.

Duggan, G. B., & Payne, S. J. (2008). Knowledge in the head and on the web: Using topic expertise to aid search. In Proceedings of the SIGCHI conference on human factors in computing systems (pp. 39–48), CHI ’08.

Eurobarometer. (2014). European citizens’ digital health literacy. Technical report, European Commision.

Fox, S. (2011). Health topics. Technical report, The Pew Internet & American Life Project.

Fox, S., & Duggan, M. (2013). Health online 2013. Technical report, The Pew Internet & American Life Project.

Gayo-Avello, D. (2009). A survey on session detection methods in query logs and a proposal for future evaluation. Information Sciences, 179(12), 1822–1843.CrossRef

Goeuriot, L., Kelly, L., Li, W., Palotti, J., Pecina, P., Zuccon, G., Hanbury, A., Jones, G. J. F., & Müller, H. (2014). ShARe/CLEF eHealth Evaluation Lab 2014, Task 3: User-centred Health Information Retrieval. In Working notes for CLEF 2014 conference, Sheffield, UK, September 15–18, 2014 (pp. 43–61).

He, D., & Göker, A. (2000). Detecting session boundaries from web user logs. In Proceedings of the BCS-IRSG 22nd annual colloquium on information retrieval research (pp. 57–66).

Herskovic, J., Tanaka, L., Hersh, W., & Bernstam, E. (2007). A day in the life of PubMed: Analysis of a typical day’s query log. Journal of the American Medical Informatics Association, 14(2), 212–220.CrossRef

Hollink, V., Tsikrika, T., & de Vries, A. P. (2011). Semantic search log analysis: A method and a study on professional image search. Journal of the American Society for Information Science and Technology, 62(4), 691–713.CrossRef

Hsieh-Yee, I. (1993). Effects of search experience and subject knowledge on the search tactics of novice and experienced searchers. Journal of the Association for Information Science and Technology, 44, 161–174.

Islamaj Dogan, R., Murray, G. C., Névéol, A., & Lu, Z. (2009). Understanding PubMed® user search behavior through log analysis. Database, 2009, bap018.

Jadhav, A. S., Sheth, A. P., & Pathak, J. (2014). Online information searching for cardiovascular diseases: An analysis of mayo clinic search query logs. Studies in Health Technology and Informatics, 205, 702–706.

Jansen, B. J., & Spink, A. (2006). How are we searching the world wide web?: A comparison of nine search engine transaction logs. Information Processing and Management, 42(1), 248–263.CrossRef

Jansen, B. J., Spink, A., Bateman, J., & Saracevic, T. (1998). Real life information retrieval: A study of user queries on the web. SIGIR Forum, 32(1), 5–17.CrossRef

Jansen, B., Spink, A., & Taksai, I. (2008). Handbook of research on web log analysis. Information science reference. Hershey, PA: IGI Global Publishing.

Jones, R., & Klinkner, K. L. (2008). Beyond the session timeout: Automatic hierarchical segmentation of search topics in query logs. In Proceedings of the 17th ACM conference on information and knowledge management (pp. 699–708), CIKM ’08, New York, NY, USA, ACM.

Kritz, M., Gschwandtner, M., Stefanov, V., Hanbury, A., & Samwald, M. (2013). Utilization and perceived problems of online medical resources and search tools among different groups of european physicians. Journal of Medical Internet Research, 15(6), e122.CrossRef

Lacroix, E.-M., & Mehnert, R. (2002). The US National Library of Medicine in the 21st century: Expanding collections, nontraditional formats, new audiences. Health Information and Libraries Journal, 19(3), 126–132.CrossRef

Lui, M., & Baldwin, T. (2012). Langid.py: An off-the-shelf language identification tool. In Proceedings of the ACL 2012 system demonstrations (pp. 25–30), ACL ’12, Stroudsburg, PA, USA, Association for Computational Linguistics.

Meats, E., Brassey, J., Heneghan, C., & Glasziou, P. (2007). Using the Turning Research Into Practice (TRIP) database: How do clinicians really search? Journal of the Medical Library Association, 95(2), 156–163.CrossRef

Névéol, A., Kim, W., Wilbur, W. J., & Lu, Z. (2009). Exploring two biomedical text genres for disease recognition. In Proceedings of the workshop on current trends in biomedical natural language processing (pp. 144–152), BioNLP ’09, Stroudsburg, PA, USA, Association for Computational Linguistics.

Névéol, A., Dogan, R. I., & Lu, Z. (2011). Semi-automatic semantic annotation of pubmed queries: A study on quality, efficiency, satisfaction. Journal of Biomedical Informatics, 44(2), 310–318.CrossRef

NLM. (2009). UMLS reference manual. Bethesda (MD): National Library of Medicine (US).

Palotti, J., Hanbury, A., & Muller, H. (2014a). Exploiting health related features to infer user expertise in the medical domain. In Proceedings of WSCD workshop on web search and data mining. Wiley.

Palotti, J., Stefanov, V., & Hanbury, A. (2014b). User intent behind medical queries: An evaluation of entity mapping approaches with metamap and freebase. In Proceedings of the 5th information interaction in context symposium (pp. 283–286), IIiX ’14, ACM.

Palotti, J., Zuccon, G., Goeuriot, L., Kelly, L., Hanbury, A., Jones, G. J. F., Lupu, M., & Pecina, P. (2015). ShARe/CLEF eHealth Evaluation Lab 2015, Task 2: User-centred Health Information Retrieval. In Working notes for CLEF 2015 conference, Toulouse, France, September 8–11, 2015.

Pass, G., Chowdhury, A., & Torgeson, C. (2006). A picture of search. In Proceedings of the 1st international conference on scalable information systems, InfoScale ’06, New York, NY, USA, ACM.

Pratt, W., & Yetisgen-Yildiz, M. (2003). A study of biomedical concept identification: Metamap vs. people. In AMIA annual symposium proceedings (Vol. 2003, pp. 529–533). American Medical Informatics Association.

Roberts, K., Simpson, M., Demner-Fushman, D., & Voorhees, E., Hersh, W. (2014). State-of-the-art in biomedical literature retrieval for clinical cases: A survey of the TREC 2014 CDS Track.

Schwarz, J., & Morris, M. (2011). Augmenting web pages and search results to support credibility assessment. In Proceedings of the SIGCHI conference on human factors in computing systems (pp. 1245–1254), CHI ’11, New York, NY, USA, ACM.

Silverstein, C., Marais, H., Henzinger, M., & Moricz, M. (1999). Analysis of a very large web search engine query log. SIGIR Forum, 33(1), 6–12.CrossRef

Silvestri, F. (2010). Mining query logs: Turning search usage data into knowledge. Foundations and Trends in Information Retrieval, 4(1:2), 1–174.MATHCrossRef

Spink, A., Yang, Y., Jansen, J., Nykanen, P., Lorence, D. P., Ozmutlu, S., et al. (2004). A study of medical and health queries to web search engines. Health Information and Libraries Journal, 21(1), 44–51.CrossRef

Tsikrika, T., Müller, H., & Kahn, C., Jr. (2012). Log analysis to understand medical professionals’ image searching behaviour. In Medical Informatics Europe.

Walsh, T. M., & Volsko, T. A. (2008). Readability assessment of internet-based consumer health information. Respiratory Care, 53(10), 1310–1315.

Wang, L., Wang, J., Wang, M., Li, Y., Liang, Y., & Xu, D. (2012). Using Internet search engines to obtain medical information: A comparative study. Journal of Medical Internet Research, 14(3), e74.CrossRef

Weeber, M., Klein, H., Aronson, A. R., Mork, J. G., de Jong van den Berg, L. T. W., & Vos, R. (2000). Text-based discovery in biomedicine: The architecture of the dad-system. In Proceedings of the AMIA symposium (pp. 903–907).

White, R. W. & Horvitz, E. (2012). Studies of the onset and persistence of medical concerns in search logs. In Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval (pp. 265–274), SIGIR ’12, New York, NY, USA, ACM.

White, R. W. , Dumais, S. T., & Teevan, J. (2009) Characterizing the influence of domain expertise on web search behavior. In Proceedings of the second ACM international conference on web search and data mining (pp. 132–141), WSDM ’09, New York, NY, USA, ACM.

White, R. W., & Horvitz, E. (2009). Cyberchondria: Studies of the escalation of medical concerns in web search. ACM Transactions on Information Systems, 27(4), 23:1–23:37.CrossRef

Wildemuth, B. M. (2004). The effects of domain knowledge on search tactic formulation. Journal of the Association for Information Science and Technology, 55(3), 246–258.CrossRef

Yan, X., Lau, R. Y., Song, D., Li, X., & Ma, J. (2011). Toward a semantic granularity model for domain-specific information retrieval. ACM Transactions on Information Systems, 29(3), 151–1546.CrossRef

Younger, P. (2010). Internet-based information-seeking behaviour amongst doctors and nurses: A short review of the literature. Health Information and Libraries Journal, 27(1), 2–10.CrossRef

Zhang, X., Cole, M., Belkin, N. (2011). Predicting users’ domain knowledge from search behaviors. In Proceedings of the 34th international ACM SIGIR conference on research and development in information retrieval (pp. 1225–1226), SIGIR ’11, ACM.

Zhang, Y. (2014). Searching for specific health-related information in MedlinePlus: Behavioral patterns and user experience. Journal of the Association for Information Science and Technology, 65(1), 53–68.CrossRef

Zuccon, G., Koopman, B., Palotti, J. (2015) Diagnose this if you can: On the effectiveness of search engines in finding medical self-diagnosis information. In Advances in information retrieval (pp. 562–567). Springer.

Titel: How users search and what they search for in the medical domain
Understanding laypeople and experts through query logs
verfasst von: João Palotti
Allan Hanbury
Henning Müller
Charles E. Kahn Jr.
Publikationsdatum: 01.04.2016
Verlag: Springer Netherlands
Erschienen in: Discover Computing / Ausgabe 1-2/2016
Print ISSN: 2948-2984
Elektronische ISSN: 2948-2992
DOI: https://doi.org/10.1007/s10791-015-9269-8

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Weitere Artikel der Ausgabe 1-2/2016

Information retrieval as semantic inference: a Graph Inference model applied to medical search

Biomedical term extraction: overview and a new methodology

Medical information retrieval: introduction to the special issue

Retrieval, visualization, and mining of large radiation dosage data

Methods for linking EHR notes to education materials

Enhancing web search in the medical domain via query clarification

Premium Partner