Pinned

MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training (AI summary)

Brandon McKinzie, Zhe Gan, Jean-Philippe Fauconnier, Sam Dodge, Bowen Zhang, Philipp Dufter, Dhruti Shah, Xianzhi Du, Futang Peng, Floris Weers, Anton Belyi, Haotian Zhang, Karanjeet Singh, Doug Kang, Hongyu Hè, Max Schwarzer, Tom Gunter, Xiang Kong, Aonan Zhang, Jianyu Wang, Chong Wang, Nan Du, Tao Lei, Sam Wiseman, Mark Lee, Zirui Wang, Ruoming Pang, Peter Grasch, Alexander Toshev, Yinfei Yang

Read more

The Geometry of Categorical and Hierarchical Concepts in Large Language Models (AI summary)

Kiho Park, Yo Joong Choe, Yibo Jiang, Victor Veitch

Read more

Discovering Preference Optimization Algorithms with and for Large Language Models (AI summary)

Chris Lu, Samuel Holt, Claudio Fanconi, Alex J. Chan, Jakob Foerster, Mihaela van der Schaar, Robert Tjarko Lange

Read more

SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales (AI summary)

Tianyang Xu, Shujin Wu, Shizhe Diao, Xiaoze Liu, Xingyao Wang, Yangyi Chen, Jing Gao

Read more

Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models (AI summary)

Ling Yang, Zhaochen Yu, Tianjun Zhang, Shiyi Cao, Minkai Xu, Wentao Zhang, Joseph E. Gonzalez, Bin Cui

Read more

Faithful Logical Reasoning via Symbolic Chain-of-Thought (AI summary)

Jundong Xu, Hao Fei, Liangming Pan, Qian Liu, Mong-Li Lee, Wynne Hsu

Read more

Scalable MatMul-free Language Modeling (AI summary)

Rui-Jie Zhu, Yu Zhang, Ethan Sifferman, Tyler Sheaves, Yiqiao Wang, Dustin Richmond, Peng Zhou, Jason K. Eshraghian

Read more

SimPO: Simple Preference Optimization with a Reference-Free Reward (AI summary)

Yu Meng, Mengzhou Xia, Danqi Chen

Read more

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality (AI summary)

Tri Dao, Albert Gu

Read more

Are Long-LLMs A Necessity For Long-Context Tasks? (AI summary)

Hongjin Qian, Zheng Liu, Peitian Zhang, Kelong Mao, Yujia Zhou, Xu Chen, Zhicheng Dou

Read more
×