2025年大语言模型能力来源与边界报告-复旦大学-2025-55页

1张奇 复旦大学大语言模型能力来源与边界4输入：Fudan University is located inLLaMA2-13B (PPL 5.877)：FudanUniversityislocatedinShanghai,China.Itislocallyknownas复旦大学.Theuniversitywasestablishedin1905.ItisaccreditedbyMinistryofEducationofthePeople'sRepublicofChina.Thereareover40,000studentsstudyinginvariouscoursesofferedbyFudanUniversity.ThelanguageofinstructionisChinese.LLaMA2-13B-修改语言非核心区LayerNorm其他维度扩大10倍 (PPL 5.914) ：Fudan University is located in Shanghai, China, the largest city with the most economic and cultural activities in China. With the most advanced infrastructure and the best living condition, it has become the international education center with the largest oversea students. It consists of Jinan, Kangqiaoand Fenglincampus, which boasts the best resources from both education and research. Fudan University has been a famous and attractive university for international students, especially in the past one decade from 2001-2010.LLaMA2-13B-修改语言核心区1维扩大10倍 (PPL 376079936) ：Fudan University is located i