AI-ISP为图像信号处理添加实时AI功能同时减少内存占用和处理延迟

AI-ISP:Adding Real–Time AI Functionality to Image Signal Processing with Reduced Memory Footprint and Processing LatencyMankit LoChief Architect, NPU IP DevelopmentVeriSiliconInc.•Image Signal Processor is responsible for processing the raw image data captured by a camera’s sensor and turning it into a usable imageWhat Is an ISP (Image Signal Processor)?2© 2023 VerisiliconISP Traditional Hardware Pipeline3© 2023 VerisiliconDemosaicLensShadingCorrectionWhite BalanceDefectPixelCorrectionDenoiseColor CorrectGamma CorrectAF, AE, AWBStatisticColor Space ConvertPost ProcessBlack Level CorrectionThe Growing Body of Research on AI for ISP4© 2023 Verisilicon•“Learning to See in the Dark”: low-light image enhancementThe Growing Body of Research on AI for ISP (cont2/3)5© 2023 Verisilicon•“Deep Joint Demosaicingand Denoising”•“Learning Deep Priors for Image Dehazing”The Growing Body of Research on AI for ISP (cont3/3)6© 2023 Verisilicon•“HDR imagereconstruction from a single exposure using deep CN