5Shopee-StarRocks在Shopee的应用和实践

●User Behavior AnalyticsAnti Fraud Rules EngineLog AnalysisReal-Time Data warehouseSupply Chain Logistics Report Video Quality AnalyticsApplication ObservabilityBusiness IntelligenceReal-Time Dashboard & AlertUser Behavior AnalyticsLogistics ReportLog PlatformReal-time DashboardData WarehouseAnti Fraud DetectionBusiness IntelligenceDQC TaskOffline AnalysisReal-time DashboardTime Series Data ProcessingMonitor & Alert System●○●○○Query is Slow&Extra ETL EffortQuery ScenarioTrino / SecondClickHouse / SecondStarRocks / SecondOLAP DB Improve times●Plain join●Join by primary key (user_id)●Filter by partition key●All output columns are from left table54.082300 +1.803StarRocks Speed up 30 times ●Plain join●Join by primary key (user_id) and another key (shop_id)●Filter by partition key●All output columns are from left table34.868300 +1.173StarRocks Speed up 30 times ●No JOIN but IN for ClickHouse●Filter by partition key●All output columns are from left table34.8682.0213.182ClickHouseSpeed up 18