How Discriminative Are Your Qrels? How To Study the Statistical Significance of Document Adjudication Methods-Reference-Cited by-同舟云学术

How Discriminative Are Your Qrels? How To Study the Statistical Significance of Document Adjudication Methods

Published:2023-10-21 Issue: Volume: Page:
ISSN:
Container-title:Proceedings of the 32nd ACM International Conference on Information and Knowledge Management
language:
Short-container-title:

Author:

Otero David¹^ORCID,Parapar Javier²^ORCID,Ferro Nicola³^ORCID

Affiliation:

1. Universidade da Coruña, A Coruña, Spain

2. Univesidade da Coruña, A Coruña, Spain

3. University of Padua, Padova, Italy

Funder

Xunta de Galicia

Ministero dell'Università e della Ricerca

MCIN

Ministerio de Universidades

Publisher

ACM

Link

https://dl.acm.org/doi/pdf/10.1145/3583780.3614916

Reference59 articles.

1. James Allan , Donna K. Harman , Evangelos Kanoulas , Dan Li , Christophe Van Gysel , and Ellen M. Voorhees . 2017 . TREC 2017 common core track overview. In Proceedings of TREC 2017. NIST Special Publication 500--324 , Gaithersburg, Maryland, USA. https://trec.nist.gov/pubs/trec26/papers/Overview-CC.pdf (cited on p. 2). James Allan, Donna K. Harman, Evangelos Kanoulas, Dan Li, Christophe Van Gysel, and Ellen M. Voorhees. 2017. TREC 2017 common core track overview. In Proceedings of TREC 2017. NIST Special Publication 500--324, Gaithersburg, Maryland, USA. https://trec.nist.gov/pubs/trec26/papers/Overview-CC.pdf (cited on p. 2).

2. Building Test Collections using Bandit Techniques

3. A unified model for metasearch, pooling, and system evaluation

4. Chris Buckley and Ellen M. Voorhees . 2000. Evaluating evaluation measure stability . In Proceedings of ACM SIGIR 2000 . ACM, New York, NY, USA, 33--40. doi: 10.1145/345508.345543 (cited on p. 6). 10.1145/345508.345543 Chris Buckley and Ellen M. Voorhees. 2000. Evaluating evaluation measure stability. In Proceedings of ACM SIGIR 2000. ACM, New York, NY, USA, 33--40. doi: 10.1145/345508.345543 (cited on p. 6).