In this second edition of the workshop on Augmented Intelligence in Technology-Assisted Review Systems (ALTARS), we focus on the evaluation of High-recall Information Retrieval (IR) systems which tackle challenging tasks that require the finding of (nearly) all the relevant documents in a collection. In fact, despite the number of evaluation measures at our disposal to assess the effectiveness of a “traditional” retrieval approach, there are additional dimensions of evaluation for these systems. During the workshop, the organizers as well as the participants will discuss these issues and prepare a set of guidelines for the preparation of a correct evaluation of these kinds of systems.

2nd Workshop on Augmented Intelligence in Technology-Assisted Review Systems (ALTARS)

Di Nunzio G. M.
Writing – Original Draft Preparation
;
2023

Abstract

In this second edition of the workshop on Augmented Intelligence in Technology-Assisted Review Systems (ALTARS), we focus on the evaluation of High-recall Information Retrieval (IR) systems which tackle challenging tasks that require the finding of (nearly) all the relevant documents in a collection. In fact, despite the number of evaluation measures at our disposal to assess the effectiveness of a “traditional” retrieval approach, there are additional dimensions of evaluation for these systems. During the workshop, the organizers as well as the participants will discuss these issues and prepare a set of guidelines for the preparation of a correct evaluation of these kinds of systems.
2023
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
45th European Conference on Information Retrieval, ECIR 2023
978-3-031-28240-9
978-3-031-28241-6
File in questo prodotto:
File Dimensione Formato  
altars2023_ecir.pdf

accesso aperto

Tipologia: Preprint (submitted version)
Licenza: Accesso libero
Dimensione 129.59 kB
Formato Adobe PDF
129.59 kB Adobe PDF Visualizza/Apri
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11577/3476044
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 2
  • ???jsp.display-item.citation.isi??? 3
  • OpenAlex ND
social impact