Future of Information Retrieval Research in the Age of Generative AI
Source: Future of Information Retrieval Research in the Age of Generative AI · arXiv Authors: James Allan, Eunsol Choi, Daniel P. Lopresti, Hamed Zamani Licence: CC-BY-4.0 — http://creativecommons.org/licenses/by/4.0/
CCC Workshop Report
December 2024
Authors:
James Allan University of Massachusetts Amherst, allan@cs.umass.edu, https://cs.umass.edu/~allan/
Eunsol Choi University of Texas at Austin / New York University, eunsol@nyu.edu, https://eunsol.github.io/
Daniel P. Lopresti Lehigh University / CCC, lopresti@cse.lehigh.edu, https://www.cse.lehigh.edu/~lopresti/
Hamed Zamani University of Massachusetts Amherst, zamani@cs.umass.edu, https://groups.cs.umass.edu/zamani/
With Support From:
Mary Lou Maher Director of Research Community Initiatives, CCC, Computing Research Association mmaher@cra.org
Haley Griffin Senior Program Associate, CCC, Computing Research Association hgriffin@cra.org
Suggested Citation:
Allan, J., Choi, E., Lopresti, D., & Zamani, H. (2024). Future of Information Retrieval Research in the Age of Generative AI CCC Workshop Report. Washington, D.C.: Computing Research Association (CRA). https://cra.org/wp-content/uploads/2024/12/Future-of-Information-Retrieval-Research-in-the-Age-of-Gen erative-AI.pdf.
Computing Community Consortium (CCC)
Table of Contents
EXECUTIVE SUMMARY
- INTRODUCTION 1.1 Background and workshop goals
- HOW THIS DOCUMENT CAME ABOUT 2.1. Pre-workshop activities: How we assembled 2.2. Workshop activities: What we discussed 2.3. Post-workshop activities: How we produced this report
- SUMMARY OF THE DISCUSSED RESEARCH TOPICS FOR FUTURE EXPLORATION 3.1. Evaluation 3.2. Training, feedback, and reasoning 3.3. Understanding and modeling users 3.4. Social ramifications 3.5. Personalization 3.6. Reducing the cost of generative IR 3.7. AI agents and information retrieval 3.8. Foundation models for information access and discovery
- SHORT-AND LONG-TERM RESEARCH TOPICS AND RECOMMENDATIONS 4.1. Evaluation 4.2. Training, feedback, and reasoning 4.3. Understanding and modeling users 4.4. Social ramifications 4.5. Personalization 4.6. Scalability and efficiency 4.7. AI agents and information retrieval 4.8. Foundation models for information access and discovery
- ADDITIONAL RECOMMENDATIONS FOR FUNDING AGENCIES AND THE RESEARCH COMMUNITIES 5.1. Recommendations for evaluation campaigns 5.2. Recommendations for shared computing infrastructure and resources 5.3. Funding programs supporting collaborative research ACKNOWLEDGMENTS Reviewers
U.S. National Science Foundation REFERENCES
A. APPENDICES A.1 Glossary A.2 CCC Workshop Participants and Report Contributors Future of Information Retrieval Research in the Age of Generative AI