MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training (AI summary)
Brandon McKinzie, Zhe Gan, Jean-Philippe Fauconnier, Sam Dodge, Bowen Zhang, Philipp Dufter, Dhruti Shah, Xianzhi Du, Futang Peng, Floris Weers, Anton Belyi, Haotian Zhang, Karanjeet Singh, Doug Kang, Hongyu Hè, Max Schwarzer, Tom Gunter, Xiang Kong, Aonan Zhang, Jianyu Wang, Chong Wang, Nan Du, Tao Lei, Sam Wiseman, Mark Lee, Zirui Wang, Ruoming Pang, Peter Grasch, Alexander Toshev, Yinfei Yang
Read more
RouteLLM: Learning to Route LLMs with Preference Data (AI summary)
Isaac Ong, Amjad Almahairi, Vincent Wu, Wei-Lin Chiang, Tianhao Wu, Joseph E. Gonzalez, M Waleed Kadous, Ion Stoica
Read more
Lookback Lens: Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps (AI summary)
Yung-Sung Chuang, Linlu Qiu, Cheng-Yu Hsieh, Ranjay Krishna, Yoon Kim, James Glass
Read more
Reasoning in Large Language Models: A Geometric Perspective (AI summary)
Romain Cosentino, Sarath Shekkizhar
Read more
Mixture of A Million Experts (AI summary)
Xu Owen He
Read more
RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMs (AI summary)
Yue Yu, Wei Ping, Zihan Liu, Boxin Wang, Jiaxuan You, Chao Zhang, Mohammad Shoeybi, Bryan Catanzaro
Read more
AI Agents That Matter (AI summary)
Sayash Kapoor, Benedikt Stroebl, Zachary S. Siegel, Nitya Nadgir, Arvind Narayanan
Read more
Summary of a Haystack: A Challenge to Long-Context LLMs and RAG Systems (AI summary)
Philippe Laban, Alexander R. Fabbri, Caiming Xiong, Chien-Sheng Wu
Read more
LLM See, LLM Do: Guiding Data Generation to Target Non-Differentiable Objectives (AI summary)
Luísa Shimabucoro, Sebastian Ruder, Julia Kreutzer, Marzieh Fadaee, Sara Hooker
Read more
Adaptable Logical Control for Large Language Models (AI summary)
Honghua Zhang, Po-Nien Kung, Masahiro Yoshida, Guy Van den Broeck, Nanyun Peng
Read more