Report on the Workshop on Simulations for Information Access (Sim4IA 2024) at SIGIR 2024
Timo Breuer, Christin Katharina Kreutz, Norbert Fuhr, Krisztian Balog,, Philipp Schaer, Nolwenn Bernard, Ingo Frommholz, Marcel Gohsen, Kaixin Ji,, Gareth J. F. Jones, J\"uri Keller, Jiqun Liu, Martin Mladenov, Gabriella, Pasi, Johanne Trippas, Xi Wang, Saber Zerhoudi
TL;DR
This report summarizes the key discussions, insights, and future directions from the Sim4IA 2024 workshop at SIGIR, emphasizing user simulation's role in advancing information access research.
Contribution
It provides an overview of the workshop's organization, key topics, and the importance of user simulation in both academic and industry contexts.
Findings
User simulation is crucial for advancing information access.
Bridging online and offline evaluation remains a challenge.
Organizing shared tasks around user simulations is beneficial.
Abstract
This paper is a report of the Workshop on Simulations for Information Access (Sim4IA) workshop at SIGIR 2024. The workshop had two keynotes, a panel discussion, nine lightning talks, and two breakout sessions. Key takeaways were user simulation's importance in academia and industry, the possible bridging of online and offline evaluation, and the issues of organizing a companion shared task around user simulations for information access. We report on how we organized the workshop, provide a brief overview of what happened at the workshop, and summarize the main topics and findings of the workshop and future work.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
Topics3D Modeling in Geospatial Applications · Geographic Information Systems Studies