Generative AI for Math: Part I -- MathPile: A Billion-Token-Scale Pretraining Corpus for Math (AI summary)
Zengzhi Wang, Rui Xia, Pengfei Liu
Read more
LLaMA Pro: Progressive LLaMA with Block Expansion (AI summary)
Chengyue Wu, Yukang Gan, Yixiao Ge, Zeyu Lu, Jiahao Wang, Ye Feng, Ping Luo, Ying Shan
Read more
Making Large Language Models A Better Foundation For Dense Retrieval (AI summary)
Chaofan Li, Zheng Liu, Shitao Xiao, Yingxia Shao
Read more
Towards Self-Assembling Artificial Neural Networks through Neural Developmental Programs (AI summary)
Elias Najarro, Shyam Sudhakaran, Sebastian Risi
Read more
The Efficiency Spectrum of Large Language Models: An Algorithmic Survey (AI summary)
Tianyu Ding, Tianyi Chen, Haidong Zhu, Jiachen Jiang, Yiqi Zhong, Jinxin Zhou, Guangzhi Wang, Zhihui Zhu, Ilya Zharkov, Luming Liang
Read more
Economics Arena for Large Language Models (AI summary)
Shangmin Guo, Haoran Bu, Haochuan Wang, Yi Ren, Dianbo Sui, Yuming Shang, Siting Lu
Read more
Effective Long-Context Scaling of Foundation Models (AI summary)
Wenhan Xiong, Jingyu Liu, Igor Molybog, Hejia Zhang, Prajjwal Bhargava, Rui Hou, Louis Martin, Rashi Rungta, Karthik Abinav Sankararaman, Barlas Oguz, Madian Khabsa, Han Fang, Yashar Mehdad, Sharan Narang, Kshitiz Malik, Angela Fan, Shruti Bhosale, Sergey Edunov, Mike Lewis, Sinong Wang, Hao Ma
Read more
Principled Instructions Are All You Need for Questioning LLaMA-1/2, GPT-3.5/4 (AI summary)
Sondos Mahmoud Bsharat, Aidar Myrzakhan, Zhiqiang Shen
Read more
Med-Flamingo: a Multimodal Medical Few-shot Learner (AI summary)
Michael Moor, Qian Huang, Shirley Wu, Michihiro Yasunaga, Cyril Zakka, Yash Dalmia, Eduardo Pontes Reis, Pranav Rajpurkar, Jure Leskovec
Read more
Retrieval-Augmented Generation for Large Language Models: A Survey (AI summary)
Yunfan Gao, Yun Xiong, Xinyu Gao, Kangxiang Jia, Jinliu Pan, Yuxi Bi, Yi Dai, Jiawei Sun, Haofen Wang
Read more