Compositional Foundation Models for Hierarchical Planning (AI summary)
Anurag Ajay, Seungwook Han, Yilun Du, Shuang Li, Abhi Gupta, Tommi Jaakkola, Josh Tenenbaum, Leslie Kaelbling, Akash Srivastava, Pulkit Agrawal
Read more
FP8-LM: Training FP8 Large Language Models (AI summary)
Houwen Peng, Kan Wu, Yixuan Wei, Guoshuai Zhao, Yuxiang Yang, Ze Liu, Yifan Xiong, Ziyue Yang, Bolin Ni, Jingcheng Hu, Ruihang Li, Miaosen Zhang, Chen Li, Jia Ning, Ruizhe Wang, Zheng Zhang, Shuguang Liu, Joe Chau, Han Hu, Peng Cheng
Read more
LLM360: Towards Fully Transparent Open-Source LLMs (AI summary)
Zhengzhong Liu, Aurick Qiao, Willie Neiswanger, Hongyi Wang, Bowen Tan, Tianhua Tao, Junbo Li, Yuqi Wang, Suqi Sun, Omkar Pangarkar, Richard Fan, Yi Gu, Victor Miller, Yonghao Zhuang, Guowei He, Haonan Li, Fajri Koto, Liping Tang, Nikhil Ranjan, Zhiqiang Shen, Xuguang Ren, Roberto Iriondo, Cun Mu, Zhiting Hu, Mark Schulze, Preslav Nakov, Tim Baldwin, Eric P. Xing
Read more
Boolformer: Symbolic Regression of Logic Functions with Transformers (AI summary)
Stéphane d'Ascoli, Samy Bengio, Josh Susskind, Emmanuel Abbé
Read more
Battle of the Backbones: A Large-Scale Comparison of Pretrained Models across Computer Vision Tasks (AI summary)
Micah Goldblum, Hossein Souri, Renkun Ni, Manli Shu, Viraj Prabhu, Gowthami Somepalli, Prithvijit Chattopadhyay, Mark Ibrahim, Adrien Bardes, Judy Hoffman, Rama Chellappa, Andrew Gordon Wilson, Tom Goldstein
Read more
FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning (AI summary)
Tri Dao
Read more
From Google Gemini to OpenAI Q* (Q-Star): A Survey of Reshaping the Generative Artificial Intelligence (AI) Research Landscape (AI summary)
Timothy R. McIntosh, Teo Susnjak, Tong Liu, Paul Watters, Malka N. Halgamuge
Read more
Evaluating Large Language Models: A Comprehensive Survey (AI summary)
Zishan Guo, Renren Jin, Chuang Liu, Yufei Huang, Dan Shi, Supryadi, Linhao Yu, Yan Liu, Jiaxuan Li, Bojian Xiong, Deyi Xiong
Read more
DocLLM: A layout-aware generative language model for multimodal document understanding (AI summary)
Dongsheng Wang, Natraj Raman, Mathieu Sibue, Zhiqiang Ma, Petr Babkin, Simerjot Kaur, Yulong Pei, Armineh Nourbakhsh, Xiaomo Liu
Read more
PaSS: Parallel Speculative Sampling (AI summary)
Giovanni Monea, Armand Joulin, Edouard Grave
Read more