School of Information and Library Sciences
University of North Carolina at Chapel Hill
September 19 | 12:00 - 1:30pm
2025 E Newport Ave, Milwaukee, WI
Human assessments of document relevance are needed for the construction of test collections, ad-hoc evaluation, and training text classifiers. However, showing documents to assessors in different orderings may lead to different assessments of the same documents and consequently different assessment outcomes. In this research, we examine the effects of priming on people’s perception and thresholding of relevance, and how need for cognition impacts relevance assessments.
About the Speaker:
Diane Kelly is an Associate Professor at the School of Information and Library Science at the University of North Carolina at Chapel Hill. Her research interests are in interactive information search and retrieval, information search behavior and evaluation methods and metrics. In 2010, she was awarded the Francis Carroll McColl Term Professorship (2010-2012) at UNC for her research accomplishments and in 2013, the British Computer Society’s IRSG Karen Spärck Jones Award. She teaches undergraduate and graduate courses on research design, interactive information retrieval and foundations of information science. She is the recipient of two teaching awards: the 2009 ASIST/Thomson Reuters Outstanding Information Science Teacher Award and the 2007 SILS Outstanding Teacher of the Year Award. She received a Ph.D. in Information Science and a Graduate Certificate in Cognitive Science from Rutgers University and an undergraduate degree in Psychology from the University of Alabama.