What Next in Logical Replication

Presented by:

Ag19 amit kapila 9614 selected

Amit Kapila

Fujitsu

Amit Kapila is a Committer and a Major Developer in PostgreSQL. Over the course of a 20-year career, he developed deep expertise in not only PostgreSQL but also Oracle, and in-memory databases. He works at Fujitsu as Senior Director.

Amit Kapila works in open source PostgreSQL. He participates actively in the development of PostgreSQL, both developing and reviewing new features. The major work done by him in PostgreSQL includes parallel-query, performance, scalability, and durable hash-indexes. In the past, he has worked on integrating in-memory storage Engine to PostgreSQL-based code and at a time he also improved the Oracle performance by doing statement caching.

Logical replication has been there since 10.0 and with each release, it is getting better. This talk will start with the basic architecture of Logical replication in PostgreSQL and then cover the various ways in which it can be helpful to users.

One of the shortcomings of logical replication as compare to physical replication is that currently, it allows the transaction to be replicated only once it is committed. This can create a large apply lag on the subscriber side for long-running transactions. We will discuss the solution implemented for this problem for PostgreSQL.

We will also discuss the other major work being done in logical replication which is to allow the streaming of transactions at the prepare time. This will help us in implementing conflict-free logical replication. This can be used for scaling out reads as well. Because of 2PC, we can ensure that on subscribers we have all the data committed on the master. Now, we can design a system where different nodes are owners of some set of tables and we can always get the data of those tables reliably from those nodes, and then one can have some external process that will route the reads accordingly.

In the end, this will cover the new enhancements, improvements related to Logical Replication being discussed in the PostgreSQL community for future releases.

Date:
2021 September 28 13:00 EDT
Duration:
1 h
Room:
Online
Conference:
2021 Postgres Conference Webinars
Language:
Track:
Dev
Difficulty:
Requires Registration:
Yes (Registered: 83)