ML and AI papers

Genie: Generative Interactive Environments (AI summary)

Jake Bruce, Michael Dennis, Ashley Edwards, Jack Parker-Holder, Yuge Shi, Edward Hughes, Matthew Lai, Aditi Mavalankar, Richie Steigerwald, Chris Apps, Yusuf Aytar, Sarah Bechtle, Feryal Behbahani, Stephanie Chan, Nicolas Heess, Lucy Gonzalez, Simon Osindero, Sherjil Ozair, Scott Reed, Jingwei Zhang, Konrad Zolna, Jeff Clune, Nando de Freitas, Satinder Singh, Tim Rocktäschel

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits (AI summary)

Language models scale reliably with over-training and on downstream tasks (AI summary)

Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, Suchin Gururangan, Mitchell Wortsman, Rulin Shao, Jean Mercat, Alex Fang, Jeffrey Li, Sedrick Keh, Rui Xin, Marianna Nezhurina, Igor Vasiljevic, Jenia Jitsev, Alexandros G. Dimakis, Gabriel Ilharco, Shuran Song, Thomas Kollar, Yair Carmon, Achal Dave, Reinhard Heckel, Niklas Muennighoff, Ludwig Schmidt

Sora Generates Videos with Stunning Geometrical Consistency (AI summary)

Xuanyi Li, Daquan Zhou, Chenxu Zhang, Shaodong Wei, Qibin Hou, Ming-Ming Cheng

When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Method (AI summary)

Biao Zhang, Zhongtao Liu, Colin Cherry, Orhan Firat

Tiny Titans: Can Smaller Large Language Models Punch Above Their Weight in the Real World for Meeting Summarization? (AI summary)

Xue-Yong Fu, Md Tahmid Rahman Laskar, Elena Khasanova, Cheng Chen, Shashi Bhushan TN

OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement (AI sumamry)

Tianyu Zheng, Ge Zhang, Tianhao Shen, Xueling Liu, Bill Yuchen Lin, Jie Fu, Wenhu Chen, Xiang Yue

Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models (AI summary)

Soham De, Samuel L. Smith, Anushan Fernando, Aleksandar Botev, George Cristian-Muraru, Albert Gu, Ruba Haroun, Leonard Berrada, Yutian Chen, Srivatsan Srinivasan, Guillaume Desjardins, Arnaud Doucet, David Budden, Yee Whye Teh, Razvan Pascanu, Nando De Freitas, Caglar Gulcehre

Chain-of-Thought Reasoning Without Prompting (AI sumamry)

Xuezhi Wang, Denny Zhou

When is Tree Search Useful for LLM Planning? It Depends on the Discriminator (AI sumamry)

Ziru Chen, Michael White, Raymond Mooney, Ali Payani, Yu Su, Huan Sun