Ctrl K
Data Engineer · Senior · System design

You need to deliver changes from a multi-terabyte production PostgreSQL database to an analytics warehouse with no more than five minutes of latency. How would you design this pipeline?

~10 min by voice

How to approach it

They're checking whether the candidate can build a reliable CDC pipeline. It matters that they understand the whole chain, from the transaction log to an idempotent merge in the warehouse, and that they see the operational risks for the production database: the snapshot, event ordering, delivery guarantees, WAL growth.

Have you seen this question in a real interview?
Answers0
Avg. score—
Strong—
Practiced0
Topics
Similar questionsDesign a system of daily batch pipelines for several hundred tables with dependencies between them. How would you handle reruns, backfills and late-arriving data? SeniorA daily pipeline loads yesterday's data into the warehouse. Sometimes it fails halfway through, and after a restart duplicates show up in the table. How would you redesign it? Mid-levelWhat's the difference between ETL and ELT? JuniorDesign an analytical data warehouse for a mid-sized online store: the data comes from the product Postgres database, a CRM and ad platforms, and the consumers are BI dashboards and analysts. Walk me through how you'd set it all up. Mid-level

Answer by voice

The interviewer will ask this question and listen. Think out loud and ask for a hint if you need one. When you're done, pause or tap “That's my answer”. In about a minute, your score and the points you covered show up here.

Sign in to answer

Best with headphones · ~10 min