使用DeGirumDeLight云平台使机器学习模型实现边缘计算

Bring Your ML Models to the Edge with the DeGirumDeLightCloud PlatformShashi ChilappagariCo-Founder and Chief ArchitectDeGirumCorp.•Not all MLmodelsare compatible with all hardware•Runtime softwarecan be hardwarespecific•Different types of ML modelsneed different softwareDeveloping AI Applications for the Edge© 2023 DeGirum Corp.2SoftwareHardwareModelsEvaluating AI Hardware Accelerators is HardBuy hardwareInstall software toolchainPort/design hardware compatible ML modelDevelop application softwareBenchmark performanceRepeat for all hardware optionsResult: Separate application software & models for each hardware optionWasted time, money, and effort© 2023 DeGirum Corp.3Problems with the Hardware Evaluation ProcessImpossible to judge a hardware option based on datasheetNo unified application software that makes evaluation easy© 2023 DeGirum Corp.41.Cloud access to AI hardware2.Software that supports multiple hardware options3.Tools to choose/port/design ML modelsDeGirumCloud Platform & M