Vision-Flan: Scaling Human-Labeled Tasks in Visual Instruction Tuning (AI summary)
Zhiyang Xu, Chao Feng, Rulin Shao, Trevor Ashby, Ying Shen, Di Jin, Yu Cheng, Qifan Wang, Lifu Huang
Read more
LongAgent: Scaling Language Models to 128k Context through Multi-Agent Collaboration (AI summary)
Jun Zhao, Can Zu, Hao Xu, Yi Lu, Wei He, Yiwen Ding, Tao Gui, Qi Zhang, Xuanjing Huang
Read more
OneBit: Towards Extremely Low-bit Large Language Models (AI summary)
Yuzhuang Xu, Xu Han, Zonghan Yang, Shuo Wang, Qingfu Zhu, Zhiyuan Liu, Weidong Liu, Wanxiang Che
Read more
FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Models (AI summary)
Gagan Bhatia, El Moatez Billah Nagoudi, Hasan Cavusoglu, Muhammad Abdul-Mageed
Read more
Recovering the Pre-Fine-Tuning Weights of Generative Models (AI summary)
Eliahu Horwitz, Jonathan Kahana, Yedid Hoshen
Read more
Transformers Can Achieve Length Generalization But Not Robustly (AI summary)
Yongchao Zhou, Uri Alon, Xinyun Chen, Xuezhi Wang, Rishabh Agarwal, Denny Zhou
Read more
DoRA: Weight-Decomposed Low-Rank Adaptation (AI summary)
Shih-Yang Liu, Chien-Yi Wang, Hongxu Yin, Pavlo Molchanov, Yu-Chiang Frank Wang, Kwang-Ting Cheng, Min-Hung Chen
Read more
Mixtures of Experts Unlock Parameter Scaling for Deep RL (AI summary)
Johan Obando-Ceron, Ghada Sokar, Timon Willi, Clare Lyle, Jesse Farebrother, Jakob Foerster, Gintare Karolina Dziugaite, Doina Precup, Pablo Samuel Castro
Read more
BASE TTS: Lessons from building a billion-parameter Text-to-Speech model on 100K hours of data (AI summary)
Mateusz Łajszczak, Guillermo Cámbara, Yang Li, Fatih Beyhan, Arent van Korlaar, Fan Yang, Arnaud Joly, Álvaro Martín-Cortinas, Ammar Abbas, Adam Michalski, Alexis Moinet, Sri Karlapati, Ewa Muszyńska, Haohan Guo, Bartosz Putrycz, Soledad López Gambino, Kayeon Yoo, Elena Sokolova, Thomas Drugman
Read more
Suppressing Pink Elephants with Direct Principle Feedback (AI summary)
Louis Castricato, Nathan Lile, Suraj Anand, Hailey Schoelkopf, Siddharth Verma, Stella Biderman
Read more