You are here

Benchmarking Domain-Specific Expert Search Using Workshop Program Committees

Authors: 
Publication Type: 
Refereed Conference Meeting Proceeding
Abstract: 
Traditionally, relevance assessments for expert search have been gathered through self-assessment or based on the opinions of co-workers. We introduce three benchmark datasets1 for expert search that use conference workshops for relevance assessment. Our data sets cover entire research domains as opposed to single institutions. In addition, they provide a larger number of topic-person associations and allow a more objective and fine-grained evaluation of expertise than existing data sets do. We present and discuss baseline results for a language modelling and a topic-centric approach to expert search. We find that the topic-centric approach achieves the best results on domain-specific datasets.
Conference Name: 
22nd ACM International Conference on Information and Knowledge Management (CIKM 2013), workshop on Computational Scientometrics: Theory and Applications
Proceedings: 
workshop on Computational Scientometrics: Theory and Applications, at the 22nd ACM International Conference on Information and Knowledge Management (CIKM 2013)
Digital Object Identifer (DOI): 
10.na
Publication Date: 
01/10/2013
Conference Location: 
United States of America
Research Group: 
Institution: 
National University of Ireland, Galway (NUIG)
Open access repository: 
No
Publication document: