关于建立基准的教程用于使用公共数据评估商业大型语言模型

IMF | Statistics1Benchmarking Commercial Large Language ModelsNOVEMBER 21, 2024Jan BatznerWeizenbaumInstitute, German Internet InstituteTechnical University Munich, Grad. Center CITIMF | StatisticsIMF | Statistics3Research on Large Language Models “Sincelargelanguagemodels,orLLMs,startedtoappearin2017,theshareofAIcontentinpatentapplicationsrelatedtoalgorithmictradinghasrisenfrom19percentin2017toover50percenteachyearsince2020,suggestingawaveofinnovationiscominginthisarea.”(IMFBlog,2024)Nassira Abbas,Charles Cohen,Dirk Jan Grolleman,Benjamin Mosk (2024): Artificial Intelligence Can Make Markets More Efficient—and More Volatile. International Monetary Fund (IMF) Blog.EconPhenomenonIMF | Statistics4Research on Large Language Models “Sincelargelanguagemodels, or LLMs, started to appear in 2017, the share of AI content in patent applications related to algorithmic trading hasrisenfrom19percent in 2017toover50percent each year since 2020,suggestingawaveofinnovation is coming in this area.” (I