Publications

Hybrid Pooling with LLMs via Relevance Context Learning

Can LLMs Evaluate What They Cannot Annotate? Revisiting LLM Reliability in Hate Speech Detection

LLM-Assisted Pseudo-Relevance Feedback

How does depression talk on social media? Modeling depression language with relevance-based statistical language models

Limitations of Automatic Relevance Assessments with Large Language Models for Fair and Reliable Retrieval Evaluation

Towards Reliable Testing for Multiple Information Retrieval System Comparisons

How Discriminative Are Your Qrels? How To Study the Statistical Significance of Document Adjudication Methods

Relevance feedback for building pooled test collections

Building Cultural Heritage Reference Collections from Social Media through Pooling Strategies: The Case of 2020’s Tensions Over Race and Heritage

The wisdom of the rankers: a cost-effective method for building pooled test collections without participant systems

Beaver: Efficiently Building Test Collections for Novel Tasks

Building High-Quality Datasets for Information Retrieval Evaluation at a Reduced Cost

Exploiting Pooling Methods for Building Datasets for Novel Tasks