DOJO使用以太网传输协议TTPoE的Exa级有损人工智能网络

HOT CHIPS 2024Tesla Transport Protocol over Ethernet (TTPoE)A new lossy, Exa-Scale fabric for the Dojo AI SupercomputerEric Quinnell, Ph.D.Dojo Fabric Lead2HOT CHIPS 2024Problem StatementTCP/IP is too slow for scaled AI interconnect•Bound by CPU SW kernelLossless fabrics are complex and brittle•Priority Flow Control (PFC) affects the global networkIdeal Fabric:•Lowest latency •Highest bandwidth•Simple SoftwareFor Tesla AI:•Layer 2 only•Collective communications and ingest•Low congestion, single application3HOT CHIPS 2024TTPoETesla Transport Protocol over Ethernet (TTPoE)is a peer-to-peer ethernet Transport Layer Protocol executed entirely in hardware.Why a custom transport protocol? 1.Vertical Integration – extend Dojo RDMA onto optical fabric2.“Lossy” ethernet network – ease of scaling, cost, congestion mgmt.3.Use 3rd party hardware – Ethernet II frames “Just Work” TCP got it right – just do it in hardware4HOT CHIPS 2024Dojo OSI LayersOSI LayerExample Protocols (TCP/IP)TCP/IP Implem