DevOps Tools for managing PostgreSQL
Kunal Jain has been working with various database technologies for over 12+ years. Formerly an Data Warehouse Architect at MModal Inc, Kunal now works as Architect for Cvent Inc's Database Engineering team where his focus has been migrating traditional client-server based application to using microservices which use Postgres and Couchbase.
Yun Guo works as a Senior Database Engineer at Cvent Inc's Database Engineering team. She is currently leading the project to automate most of the manual work using Chef and other DevOps tools. She is also pursuing her PHD at George Mason in localizing faults in sql predicate.
Cvent, Inc. is the world's leading provider of cloud-based software for meetings and event management. From online event registration to meeting site selection to web surveys, we manage it all. In early 2015, our technology team started the move to SOA and microservices and adopted SCRUM methodology: an iterative and incremental agile software development framework for managing product development. Most of these microservices use PostgreSQL as datastore and they communicate with each other via RESTful APIs. With the increase in sprint teams across each of these services we have seen a dramtic increase in number of PostgreSQL clusters. For this talk, we would like to present how Cvent has leveraged its home grown provisioning system (collection of API-calls to VMWare) with various DevOps tools to automate the entire process of provisioning and setup of the PostgreSQL Clusters. In addition to using Datadog for monitoring, we have also created a data collection framework which allows us to collect the a standard set of metrics across all the Postgres servers which helps us better plan for future growth. The presentation should give new ideas for how to automate managing Postgres in a microservices environment.
- 50 min
- PGConf US 2017 [PgConf.US]