PGCon2009 - Final Release

PGCon 2009
The PostgreSQL Conference

Speakers
Gavin M. Roy
Schedule
Day Talks - second day - 2009-05-22
Room DMS 1150
Start time 15:00
Duration 01:00
Info
ID 118
Event type Lecture
Track Scaling Out
Language used for presentation English

Introduction to Golconde

Golconde is a queue-based data distribution system

Learn about Golconde, a queue-based data distribution system developed at myYearbook.com. In implementing data distribution via external message queues, Golconde differentiates itself from traditional PostgreSQL replication tools, moving the workload for replication management outside of PostgreSQL itself. We will review the design decisions that resulted in Golconde as well as see it in action.

Golconde is a queue based replication solution for PostgreSQL written in Python. It is designed to be loosely coupled and rely upon existing enterprise messaging systems that have STOMP protocol support. Designed to scale easily and with multi-data center implementations in mind, the application and message queues for distribution live outside of the database. By decoupling Golconde from PostgreSQL it is differentiated from existing replication solutions, moving the workload from the database tier, where CPU, RAM and IO overhead can be very expensive, to a commodity layer where the operational cost for performing the data distribution work is much less expensive.

In this session we will review the architecture and implementation details of Golconde and examples of its use at myYearbook.com, including a live demonstration that illustrates the ease of setup and operation.