4Cloudera-基于StarRocks和Cloudera搭建湖仓一体平台

Data WarehouseETLData MartsBI Analytics / GraphsData SourceHadoop Data LakeMPP/DWETLStreamingBI Analytics / GraphsDLMLData MartsData SourceData PreparationData SourceDLMLStreamingBI Analytics / GraphsData Catalog | Workload Manager | GovernanceODS -> DWD -> DMS -> ADSData Lakehouse~PC时代，DW1.02000s~互联网时代，DW2.02010s~移动互联网，大数据+数据湖+DW3.02020s~云原生数据湖时代，湖仓一体单机+小机集群+一体机，集中式高可靠分布式+通用X86服务器，分布式高扩展云原生，Lakehouse•••••••••••••••••(7.1.9 SP1)HDFSRangerAtlasIcebergZookeeperAvroOozieHMSKafkaImpalaSparkStreams Message MgrReplication ManagerCloudera ManagerSchema RegistryOzoneKnoxKuduHiveSolrPhoenixParquetLivyHueSqoopHBaseZeppelinORCYARNKey Trustee ServerKey HSMNavigator EncryptStreams Replication MgrCruise ControlKafka StreamsKafka ConnectTez•••★★★ObjectStorageQuery EnginesAny CSPObject StoreMetastoreUnified Table Format●●CLOUDERA ICEBERG REST COMPATIBLE METASTORE●●●●●●●●●●●●●●●●●●●●Hive MetastoreStarRocksHiveHiveStarRocksHiveCloudera lakehouse enginesSDX摄取流式处理和数据流数据工程数据仓库运营数据库人工智能& 机器学习CLOUDERA消费机器学习仪