https://www.chenk.top/en/tags/stream-processing/Recent content in Stream Processing on Chen Kai BlogHugoenThu, 24 Jul 2025 09:00:00 +0000https://www.chenk.top/en/system-design/07-data-pipelines/Thu, 24 Jul 2025 09:00:00 +0000https://www.chenk.top/en/system-design/07-data-pipelines/<p>Every second, a large e-commerce platform generates thousands of data points: page views, search queries, add-to-cart events, purchases, inventory changes, price updates, and delivery status changes. This raw data is useless in its original form — scattered across dozens of services, stored in different formats, and arriving at unpredictable rates. The system that transforms this raw data into actionable insights — real-time dashboards, personalized recommendations, fraud detection alerts, business reports — is the data pipeline.</p>