The ability to properly rank arguments according to specific principles may play an important role in Argument Retrieval tasks. However the clear definition of such criteria that can be used to rank retrieved arguments, or the documents they are part of, is a challenging task. Indeed, these principles are typically specific to the domain of application, and even experts may disagree on their definitions. For example, the concept of "similarity" between arguments could be subject to different interpretations and may change a lot according to the context and the final purpose. In this talk, we discuss case studies in different domains (news, legal documents, medical literature), analyzing characteristics, potential applications, and the challenges that arise.
Touché at CLEF 2022
Synopsis/Call
Decision making processes, be it at the societal or at the personal level, often come to a point where one side challenges the other with a why-question, which is a prompt to justify some stance based on arguments. Since technologies for argument mining are maturing at a rapid pace, also ad-hoc argument retrieval becomes a feasible task in reach. We invite you to participate in the third Touché lab on argument retrieval at CLEF 2022 featuring three tasks. [overview paper]
Shared Tasks
- Argument Retrieval for Controversial Questions
- Argument Retrieval for Comparative Questions
- Image Retrieval for Arguments
Register for the CLEF 2022 conference and Touché workshop:
Registration informationImportant Dates
November 15, 2021: Registration opens [register].April 22, 2022: Registration closes.May 2, 2022: Approaches submission deadline.May 27, 2022: Participant paper submission.June 13, 2022: Peer review notification.Mid June, 2022: Evaluation results out.July 1, 2022: Camera-ready participant papers submission [template] [instructions] [CLEF instructions] [submit].September 5-8, 2022: CLEF Conference [register].September 8, 2022: Touché Workshop on Argument Retrieval.
All deadlines are 23:59 CEST.
Keynote
Program
Touché was part of the CLEF 2022 conference program. All session times are given in Bologna local time (CEST).
Thursday, September 8. | |
Touché: Argument Retrieval Workshop was held online [slides] | |
09:00-09:05 | Welcome |
09:05-09:45 | Session 1: Argument Retrieval for Controversial Questions |
09:05-09:15 | Overview of Task 1 on Argument Retrieval for Controversial Questions (Timon Gurke) [paper] |
09:15-09:25 | Team Bruce Banner at Touché 2022: Argument retrieval for controversial questions (Bernardo Moreira) [paper] [slides] |
09:25-09:35 | The Pearl Retriever: Two-Stage Retrieval for Pairs of Argumentative Sentences (Sebastian Schmidt) [paper] [slides] |
09:35-09:45 | Team INTSEG on Argument Retrieval for Controversial Questions (Paria Tahan) [paper] |
09:45-10:00 | Best of Touché 2021: Query Expansion, Argument Mining and Document Scoring for an Efficient Question Answering System (Alaa Alhamzeh) |
10:00-10:30 | Keynote: Ranking Arguments and Argumentative Documents: Case Studies and Challenges (Andrea Galassi) [slides] |
10:30-11:00 | Coffee break |
11:00-11:40 | Session 2: Argument Retrieval for Comparative Questions |
11:00-11:10 | Overview of Task 2 on Argument Retrieval for Comparative Questions (Alexander Bondarenko) [paper] |
11:10-11:20 | Grimjack at Touché 2022: Axiomatic re-ranking and query reformulation (Jan Heinrich Reimer) [paper] [slides] |
11:20-11:30 | LeviRank: Limited query expansion with voting integration for document retrieval and Ranking (Ashish Rana) [paper] [slides] |
11:30-11:35 | Stacked model based argument extraction and stance detection using embedded LSTM model (Pavani Rajula) [paper] [slides] |
11:35-11:40 | Retrieving comparative arguments using deep language models (Viktoriia Chekalina) [paper] [slides] |
11:40-12:10 | Session 3: Image Retrieval for Arguments |
11:40-11:50 | Overview of Task 3 on Image Retrieval for Arguments (Johannes Kiesel) [paper] |
11:50-12:00 | Aramis at Touché 2022: Argument detection in pictures using machine learning (Jan Braker) [paper] |
12:00-12:10 | Boromir at Touché 2022: Combining natural language processing and machine learning techniques for image retrieval for arguments (Miriam Louise Carnot) [paper] |
12:20-12:30 | Closing: remarks, plenary discussion, future plans |