人工智能推动超越边界-记忆是关键因素

1| ©2024 SNIA. All Rights Reserved. AI: Pushing Infra boundariesMemory is a key factorPresented byManoj Wadekar, MetaAI Systems Technologist2 | ©2024 SNIA. All Rights Reserved. Meta – Community Statisticspeople use at least one of Meta services monthly, approximately3.98BFamily Daily active users3.19BRef: Meta 4Q'23 Results3 | ©2024 SNIA. All Rights Reserved. §Ranking and Recommendations§Personalized Recommendations§Deep Learning Recommendation Models (DLRM)§Training and Inference•Generative AI: Large Language Models and more•Llama2•Open access to LLMs for research and commercial use•Training and Inference (Prefill and Decode)AI Use Cases at Meta4 | ©2024 SNIA. All Rights Reserved. AI Challenging DC Infra5 | ©2024 SNIA. All Rights Reserved. AI needs for DC Infra§CPU-centric Scale-out applications§Millions of small stateless applications §Failure handling through redundancy§Scale performance through large number of nodes •Accelerator-centric AI Apps•AI job spread across 1000’s of GPUs •