Pandora's Box or Aladdin's Lamp: A Comprehensive Analysis Revealing the Role of RAG Noise in Large Language Models (AI summary)
Jinyang Wu, Feihu Che, Chuyuan Zhang, Jianhua Tao, Shuai Zhang, Pengpeng Shao
Read more
A Comprehensive Evaluation of Quantized Instruction-Tuned Large Language Models: An Experimental Analysis up to 405B (AI summary)
Jemin Lee, Sihyeong Park, Jinse Kwon, Jihun Oh, Yongin Kwon
Read more
MemLong: Memory-Augmented Retrieval for Long Text Modeling (AI summary)
Weijie Liu, Zecheng Tang, Juntao Li, Kehai Chen, Min Zhang
Read more
To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoning (AI summary)
Zayne Sprague, Fangcong Yin, Juan Diego Rodriguez, Dongwei Jiang, Manya Wadhwa, Prasann Singhal, Xinyu Zhao, Xi Ye, Kyle Mahowald, Greg Durrett
Read more
LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA (AI summary)
Jiajie Zhang, Yushi Bai, Xin Lv, Wanjun Gu, Danqing Liu, Minhao Zou, Shulin Cao, Lei Hou, Yuxiao Dong, Ling Feng, Juanzi Li
Read more
Agents in Software Engineering: Survey, Landscape, and Vision (AI summary)
Yanlin Wang, Wanjun Zhong, Yanxian Huang, Ensheng Shi, Min Yang, Jiachi Chen, Hui Li, Yuchi Ma, Qianxiang Wang, Zibin Zheng
Read more
OLMoE: Open Mixture-of-Experts Language Models (AI summary)
Niklas Muennighoff, Luca Soldaini, Dirk Groeneveld, Kyle Lo, Jacob Morrison, Sewon Min, Weijia Shi, Pete Walsh, Oyvind Tafjord, Nathan Lambert, Yuling Gu, Shane Arora, Akshita Bhagia, Dustin Schwenk, David Wadden, Alexander Wettig, Binyuan Hui, Tim Dettmers, Douwe Kiela, Ali Farhadi, Noah A. Smith, Pang Wei Koh, Amanpreet Singh, Hannaneh Hajishirzi
Read more
On the Diagram of Thought (AI summary)
Yifan Zhang, Yang Yuan, Andrew Chi-Chih Yao
Read more
Strategic Chain-of-Thought: Guiding Accurate Reasoning in LLMs through Strategy Elicitation (AI summary)
Yu Wang, Shiwan Zhao, Zhihu Wang, Heyuan Huang, Ming Fan, Yubo Zhang, Zhixing Wang, Haijun Wang, Ting Liu
Read more
Qwen2.5-Coder Technical Report (AI summary)
Binyuan Hui, Jian Yang, Zeyu Cui, Jiaxi Yang, Dayiheng Liu, Lei Zhang, Tianyu Liu, Jiajun Zhang, Bowen Yu, Kai Dang, An Yang, Rui Men, Fei Huang, Xingzhang Ren, Xuancheng Ren, Jingren Zhou, Junyang Lin
Read more