Challenges of Distributing Postgres: A Citus Story
Ozgun is a co-founder and the CTO at Citus Data. Prior to Citus, Ozgun worked as a software developer for four years in the Distributed Systems Engineering team at Amazon. There, he proposed, designed, and implemented novel algorithms on distributed caching and consistency; and also worked on building systems for scalable data analytics. Ozgun earned his M.S. in Computer Science from Stanford University, and his B.S. from Galatasaray University. He also holds patents on distributed cache consistency and load balancing.
No video of the event yet, sorry!
Citus scales out PostgreSQL through using the extension APIs. To do this, Citus shards and replicates data, performs distributed deadlock detection, and parallelizes queries across a cluster of machines.
This talk describes the distributed systems challenges we faced at Citus and how we addressed them. In particular, we'll talk about three problems we tackled when scaling out Postgres:
- Three strategies to high availability and disaster recovery in Postgres
- Using Postgres' extension framework to route and parallelize queries across a cluster of machines
- The relationship between distributed consistency and locks; and how to resolve distributed deadlocks
Finally, we'll talk about open challenges around scaling out Postgres. We'll then conclude the talk with Q&A.
- 50 min
- PostgresConf US 2018