Data Career Hub
Menu
SQLPythonPySparkApache SparkKafkaAirflow

Study planner

System design tracker

Data engineering design scenarios: lakes, CDC, streaming, analytics, ML data and more. 52 topics. Open a topic to study it, then tick your progress.

Attempted, Revised and a confidence score (1–5) for each topic, as in the planner spreadsheet. A topic counts as complete once it is marked attempted.

Saved in this browser only. Back it up from the study planner page.

#TopicCategoryLevelAttemptedRevisedConfidence
1Design a Data Lake on cloud object storageStorage & LakehouseAdvanced
2Design a Lakehouse (bronze/silver/gold)Storage & LakehouseAdvanced
3Design a CDC pipeline from OLTP to warehouseIngestion & CDCAdvanced
4Design a real-time streaming platformStreamingExpert
5Design an event-driven architectureStreamingAdvanced
6Design an analytics / BI platformAnalyticsAdvanced
7Design a Customer 360 platformAnalyticsAdvanced
8Design a fraud detection pipelineStreamingExpert
9Design a recommendation data pipelineML DataAdvanced
10Design a feature storeML DataExpert
11Design a metrics / KPI platformAnalyticsAdvanced
12Design an ELT pipeline with dbtBatch ETLIntermediate
13Design a batch ingestion frameworkIngestion & CDCIntermediate
14Design a data quality frameworkGovernanceAdvanced
15Design a data observability systemGovernanceAdvanced
16Design a data catalog & lineage systemGovernanceAdvanced
17Design a GDPR/PII compliant pipelineGovernanceAdvanced
18Design a clickstream analytics pipelineStreamingAdvanced
19Design an IoT sensor data pipelineStreamingAdvanced
20Design a log ingestion & search platformStreamingAdvanced
21Design a near-real-time dashboard backendAnalyticsAdvanced
22Design a slowly changing dimension frameworkBatch ETLAdvanced
23Design an idempotent reprocessing systemBatch ETLAdvanced
24Design a multi-tenant data platformPlatformExpert
25Design a cost-optimized warehouse strategyPlatformAdvanced
26Design a data mesh architecturePlatformExpert
27Design a streaming ETL with Kafka + SparkStreamingExpert
28Design a near-zero downtime migrationPlatformExpert
29Design an A/B testing data pipelineAnalyticsAdvanced
30Design a marketing attribution pipelineAnalyticsAdvanced
31Design a financial reconciliation pipelineBatch ETLAdvanced
32Design a time-series metrics storeStorage & LakehouseAdvanced
33Design a search indexing pipelineStreamingAdvanced
34Design a notification/alerting pipelineStreamingIntermediate
35Design an order-events processing systemStreamingAdvanced
36Design a payment events pipeline (exactly-once)StreamingExpert
37Design a ride-hailing surge pricing pipelineStreamingExpert
38Design a social media feed analytics systemAnalyticsAdvanced
39Design a video streaming analytics pipelineAnalyticsAdvanced
40Design an e-commerce inventory sync systemIngestion & CDCAdvanced
41Design a unified batch + streaming (Lambda/Kappa)PlatformExpert
42Design a data warehouse for a SaaS productStorage & LakehouseAdvanced
43Design a churn prediction data pipelineML DataAdvanced
44Design a real-time leaderboardStreamingAdvanced
45Design a geospatial analytics pipelineAnalyticsExpert
46Design an ad-bidding analytics pipelineStreamingExpert
47Design a backfill & late-data handling systemBatch ETLAdvanced
48Design a schema registry & contract systemGovernanceAdvanced
49Design a self-serve analytics platformPlatformExpert
50Design an LLM/RAG data ingestion pipelineML DataExpert
51Design a vector embeddings pipelineML DataExpert
52Design a data SLA & freshness monitoring systemGovernanceAdvanced

Other trackers

Search
Filter by type