Blog

• Amazon
• Pivotal
• 2ndQuadrant
• Microsoft
• Timescale
• HighGo
• Data Dog
• Fivetran
• BlueTalon
• Goldman Sachs
• forhims
• Immuta

As part of the countdown to PostgresConf US 2018, learn more about about featured Platinum Sponsor 2ndQuadrant, including their commitment to partnering with and contributing to the Postgres community, from Simon Riggs, Chief Technology Officer, of 2ndQuadrant and PostgreSQL Major Developer/Committer:

Tell us about your commitment to the PostgreSQL Community.

The 2ndQuadrant vision is to be the bridge between the database needs of enterprise users and open source contributions to PostgreSQL. We have pursued a joint strategy of providing both working code (available now) and later submitting the features into core PostgreSQL. Over the past 15+ years, our team has widely contributed to the growth and development of the PostgreSQL project; partnering with customers to identify bottlenecks and then contribute towards enterprise features that address them in PostgreSQL, benefiting everyone that uses it. Besides contributing code, all members of the 2ndQuadrant team are very active in the community on an individual and local level, often helping to organize PUG events, conferences, and meetups.

Are there any rising stars in the community you’d like to give props to? 

Marco Nenciarini - located in Prato, Italy - has been a long time supporter and contributor of PostgreSQL. He is an active maintainer of PGDG’s APT repository, maintaining builds and binaries for PostgreSQL and associated tools & extensions, while contributing towards process improvement for sane builds. Marco is the lead developer for Barman, a backup manager and disaster recovery tool for enterprises with high business continuity requirements.  He is the current president of IT.PUG in Italy and a part of the organizing committee for PGDay.IT.

What features would you like to see in v11 and v12?

As PostgreSQL matures, so do the features that come with each release. In the next two release we’re most looking forward to improved Partitioning performance, the implementation of the MERGE SQL command, and procedures that allow server-side transactions.

Are there any features in development from 2ndQuadrant that the community should be looking forward to?

2ndQuadrant is working hard on the development of Bi-Directional Replication (BDR3), containing new architectural features and a wide and deep set of features.

In addition, we continuously work on features for scalability, performance, security and robustness.

What is the number one barrier you see to contributing to the Postgres community?

The Postgres community is one of the easiest communities to become a part of. With an open mindset all around and a common goal of growing open source PostgreSQL, the community is very accepting to anyone looking to learn, contribute, and better the Postgres ecosystem as a whole. Between the helpful tools on postgresql.org and the growing community, comprised of seasoned veterans and fresh faces, there is always helpful information to guide you.

What is the best thing about working with the Postgres community?

PostgreSQL is the most popular database when it comes to new adoption. Even existing users of other databases are flocking towards PostgreSQL - and it’s not just to save money. PostgreSQL has been growing year on year and we’re attracting interest from the largest enterprises, as it is fully capable of securely supporting enterprise database systems. 

There is still competition out there, especially with the current fad of developer-focused NoSQL databases. But the community is big enough and strong enough to quickly adapt to changing times and push forwards. The members of the PostgreSQL community are passionate about their work and the growth of the project.

Tell us why you believe people should attend PostgresConf 2018 in April.

Community conferences expand your knowledge in different areas of the technology, describe practical use cases as well as give sneak previews into cutting edge technologies for future versions of PostgreSQL. 

Simon along with Tom Kincaid, General Manager of 2ndQuadrant, presents "Internet of Things with PostgreSQL - Performance & Security" on Friday, April 20, at 8:50 am. Tom also presents "Postgres -- Past, Present and Future" and will discuss the challenges that may be faced by Postgres in the next 5 years on Thursday, April 19, at 3:20 pm. 

Visit the 2ndQuadrant team in the Exhibit Hall in the Newport Grand Ballroom on Wednesday, April 18, and Thursday, April 19.  

Check out the full schedule for PostgresConf US 2018, and buy your tickets soon!

PostgresConf US 2018 is in 9 days. Here is the obligatory "Buy your tickets" reminder! If you look around (a Google search of Gold sponsor Google Cloud is a good place to start) you will find a lot of discount codes.

In 2017 we launched a community wide effort to better recognize contributors for not only the conference but the wider Postgres Community. We continued this effort in 2018 and are pleased to have many speaker profiles available, with more being published every day:

• Les McMonagle
• Malcolm McLean
• Elizabeth Zalman
• Hubert Zhang of Pivotal
• Baron Schwartz
• Jignesh Shah
• Tim Gorman
• Tom Limoncelli

As part of the countdown to PostgresConf US 2018, learn more about about featured Platinum Sponsor Microsoft, including their commitment to partnering with and contributing to the Postgres community:

You are newer in the Postgres community. Tell us how you contribute (or how you plan to).

We are excited to be working with PostgreSQL community. We would love to partner with the community to bring our experience, from building SQL Server over the years, to PostgreSQL – and to learn in areas where PostgreSQL excels. We have already engaged on pgsql-hackers mailing list and working with the community on patches. Moving forward, we will continue to contribute back and partner with the community in the service of our customers. As we look forward, the possibilities of what we can work together on are amazing.

How do you foresee yourself helping the Postgres community?

As mentioned above, we would love to share our learnings from working on SQL Server with the PostgreSQL community. While there are many areas that we can work on together with the community, a couple of areas to highlight would be connectivity for the cloud and making PostgreSQL more robust and compatible in Windows development environment.

What challenges did you face building AzureDB?

A key learning for us while working on Azure Database for PostgreSQL has been that the fundamental needs of the CIO from any database in the cloud is quite similar – cost saving, fundamentals like reliability, performance and scale, as well as security. In the 9 months between preview and general availability, we heard similar feedback again and again from customers and worked on these key areas. For example, we ensures that there is built-in HA so developers can be confident of their customer experience. Similarly we ensure that we have worldwide but also local compliance to serve customer needs across the globe.  

What goals do you have for the Postgres community?

Microsoft’s mission is to enable every person and every organization on the planet to achieve more. To make this mission meaningful for our customers, we intend to meet them where they are, helping them to be productive with the technologies and tools of their choice. PostgreSQL has a strong community and is one of the most loved open source databases, bringing industry leading innovations to customers.

What is the number one barrier you see to contributing to the Postgres community?

For us this is start of an important and enduring journey and so far we have had great support from the community.

What is the best thing about working with the Postgres community?

PostgreSQL is a global community with talented engineers. So the best things about working with the community is the learning and sharing of experiences with the some great minds.

Tell us why you believe people should attend PostgresConf 2018 in April.

Because it is the best place to learn, interact, and network with everyone working on Postgres – either building Postgres or users of Postgres.

About Microsoft:

Microsoft's mission is to empower every person and every organization on the planet to achieve more. With its Data & AI solutions, Microsoft enables developers to easily build and deliver intelligent apps by offering productive and familiar tools to integrate data and built-in AI. To offer more choice and flexibility to developers, Microsoft has now introduced Azure Database for PostgreSQL, a PaaS offering for PostgreSQL.

Mark Bolz, Principal Program Manager with the Microsoft Azure Data Group, presents "General Data Protection Regulation (GDPR) with Azure Database for PostgreSQL" on Wednesday, April 18 at 4:30 pm. Principal Program Manager Sunil Kamath presents "Combine the Power of Community PostgreSQL and Microsoft Azure to Migrate Existing or Build New Apps" on Friday, April 20 at 12:50 pm -- see event listing for location (subject to change).

Rohan Kumar, Corporate Vice President of Azure Data at Microsoft, will present the Microsoft keynote on April 19 at 3:40 pm, in the Newport Grand Ballroom. Visit the Microsoft team in the Exhibit Hall in the Newport Grand Ballroom on Wednesday, April 18, and Thursday, April 19.  

Check out the full schedule for PostgresConf US 2018, and buy your tickets soon!

As part of the countdown to PostgresConf US 2018, learn more about the engaging content and our speakers for this year in our Speaker Spotlight Series.

Les McMonagle is the VP of Security Strategy, at BlueTalon Inc. He will be presenting "Achieving Data Privacy Compliance in Postgres or Greenplum" on Friday, April 20, at 10:50 am. Attend his session to learn  the difference between Data Protection versus Data Access Control – and why you should care, and read what he has to say about PostgreSQL and Greenplum:

Why PostgreSQL?

BlueTalon's Attribute Based Access Control (ABAC) technology has been developed to fully support PostgreSQL and Greenplum because these are broadly implemented data analytics platforms used for storing and processing of sensitive or regulated data across industries.    

Tell us about your involvement with the greater Postgres community.

PostgreSQL was one of the first platforms BlueTalon developed an Enforcement Point (EP) for to provide centrally managed, consistently applied fine-grained data access controls, audit trail and accountability for all access to sensitive or regulated data stored in PostgreSQL database platforms. 

What new features of PostgreSQL 10 are you most excited about?

BlueTalon ensures full compatibility with each new release and corresponding new features or functionality for PostgreSQL as part of our standard certification process. 

Why should attendees come to your talk at PostgresConf US 2018? What would you like for them to take away from your session?

To learn about next generation data access controls for relational databases and  other data repository platforms and how this ABAC technology integrates seamlessly with PostgresSQL and other database technologies.

What sessions are you most excited about attending at PostgresConf US 2018?

Any data security related sessions.

What is your favorite aspect of PostgresConf US?

Firsthand contact and interaction with technology thought leaders at global corporations. 

What advice would you have for a Computer Science graduate or entry level developer who are interested in learning and engaging with Postgres?

Consider all aspects of designing and implementing any data analytics platform including data protection and access control.  "Privacy by Design" should be a core component of any requirements gathering and system design process.  Data security is an order of magnitude easier and less expensive to build in than it is to try and bolt on later.   

Check out the full schedule for PostgresConf US 2018, and buy your tickets soon!

As part of the countdown to PostgresConf US 2018, learn more about the engaging content and our Diamond and Platinum sponsors for this year in our Sponsor Spotlight Series.

Brad Nicholson is a database engineer and the PostgreSQL team lead at Compose, an IBM Company, which is one of our Platinum Sponsors for PostgresConf US 2018. Compose runs a PostgreSQL as a service platform, and has long been a supporter of the Postgres community through contributions and support. Read what Brad has to say about Compose and Postgres:

Tell us about your commitment and contribution to the Postgres Community.

Postgres is a big part of our business, and one that is rapidly growing.  As such, our  commitment is pretty self-explanatory – we are committed to postgres and the PG Community. Basically, the better PG is/becomes, the better product we can build on top of it. Our biggest contribution to the community is probably Governor.  While we have since deprecated that project, Patroni is a fork of it, and uses the HA template we created with Governor. 


What particular challenges did you face when building multi platform deployments with Postgres?

Lack of management API was one of the biggest challenges.  This leads to less than desirable patterns like having to run Patroni and Postgres in the same container, effectively tying the lifecycle of the two together. There are also a number of places where log parsing is still required to ensure the validity of an operation (like ensuring PITR \ restores actually restored to the point you specified).  These sorts of patterns are challenging to handle and often lead to less than desirable architectural patterns at the platform level.

What growth pattern do you expect for yourself as well as Postgres as a whole?

I've been using Postgres since 2001. To watch its growth over the years has been impressive, especially over the past few years.

Postgres has long established itself as the number one Open Source RDBMS.  With the huge shift we have seen towards open source adoption in the past several years, I only see it's growth continuing to accelerate.

As an organizer of the Toronto Postgres User Group I'd personally like to get more involved in the community again.  I'm not a C developer, so advocacy and helping people out via the lists/slack/etc where I can.  Now that we've deprecated Governor, I'm also looking forward to contributing to the Patroni project more.

What features would you like to see in v11 and v12?

My number one ask is Failover Slots.  Without them, it makes it difficult to for us to give our customers access to Logical Replication and Logical Decoding.  We use streaming replication for HA, and abstract those details away from our users. A HA failover will break whatever systems are built on these constructs - we lose the replication slot that maintains the place in the decoding stream, most likely requiring a resync of the dependent systems.  That is not a great story for people building downstream systems.

The other thing I'd love to see is connection pooling in core.  This has been a huge Achilles heel in Postgres for ages. Pgbouncer and pgPool are nice products to help work around the limitations, but they are severely limited when it comes to multi-tenant systems.These systems frequently need to spread their connections out across multiple users and/or multiple databases within a given cluster. Because we can't share these connections via external pools, we end up with connection explosions. 

What is the number one barrier you see to contributing to the Postgres community?

 Not a very exciting answer, but time. There just aren't enough hours in the day to fit everything in.

What is the best thing about working with the Postgres community?

How helpful, open and responsive the people in the Community are.  When you have a question or problem, getting direct access to people via the mailing lists, Slack, etc is great.  Often you'll be talking with the folks that wrote the code in the first place.  People are always really helpful.

Tell us why you believe people should attend PostgresConf 2018 in April.

This conference is an amazing opportunity to learn about all sort of different areas from the experts.  Meeting folks face to face is always another huge benefit.

Visit the Compose team in the Exhibit Hall in the Newport Grand Ballroom on Wednesday, April 18, and Thursday, April 19.  IBM Senior Developer Advocate Raj Singh will present  "Do data science and machine learning with Postgres on the IBM Cloud" in his keynote on April 19 at 3 pm, which also takes place in the Newport Grand Ballroom.

Check out the full schedule for PostgresConf US 2018, and buy your tickets soon!

As part of the countdown to PostgresConf US 2018, learn more about the engaging content and our speakers for this year in our Speaker Spotlight Series.

Malcolm McLean of Apace Systems is a PostgreSQL DBA, Linux admin, Java/PHP developer and according to his bio "a bit of a pedantic perfectionist", with over 12 years of experience with PostgreSQL and somewhat more than that with Linux and development.

Malcolm is presenting "PostgreSQL in a Geographically Distributed Realtime Transactional System" on Thursday, April 19, at 11:20 am. Read what he has to say about Postgres and why to attend his session: 

Why PostgreSQL?

My very first job over 13 years ago introduced me to Postgres after having only worked with MySQL at university. Since then, I've been happier with its performance compared to other DB's I've benchmarked as well as with the features that are continuously introduced to keep the database on the forefront. Across 3 companies I have never looked back and never regretted my decision to always use Postgres.

Tell us about your involvement with the greater Postgres community.

I spoke at the first PgConf South Africa last year and I'm now one of the organisers of PostgresConf South Africa 2018.

What new features of PostgreSQL 10 are you most excited about?

Definitely the integrated logical replication without the need of an extension.

What features should be developed/improved and released in the next major upgrade?

It perhaps won't make Postgres 11, but at least by Postgres 12 we should have BDR integrated with the current logical replication capabilities rounded off.

Why should attendees come to your talk at PostgresConf US 2018? What would you like for them to take away from your session?

We had an interesting replication problem to solve. Multi-master replication where data needed to be replicated betweens servers in multiple countries, some with data restrictions, but without replicating data where it didn't need to go. So a sort of conditional sharding with redundancy in each data center.

What sessions are you most excited about attending at PostgresConf US 2018?

 The talks on replication (anything to make our lives easier) and security. 

What is your favorite aspect of PostgresConf US?

Meeting like-minded people from different backgrounds. And of course, the trip itself. I've done quite a bit of travelling over the years, but I haven't yet been to the US.

What advice would you have for a Computer Science graduate or entry level developer who are interested in learning and engaging with Postgres?

Push yourself to learn. Sitting back doesn't get you very far. 

Check out the full schedule for PostgresConf US 2018, and buy your tickets soon!

As part of the countdown to PostgresConf US 2018, learn more about the engaging content and our speakers for this year in our Speaker Spotlight Series.

Elizabeth Zalman is the Co-founder & CEO of strongDM, the definitive data security product. Previously she was Co-Founder and CEO of the cross-device profile company Media Armor.

Liz will be presenting a breakout session "Do You Know Your Vendor Dependencies" on Wednesday, April 18, at 4 pm. Read what she has to say about Postgres and why to attend her session: 

Why PostgreSQL? What got you into it, and made you stick with it?

Featureful performance & proven reliability. Over the years I've found fewer and fewer reasons to consider alternatives beyond Postgres (two notable exceptions being redis-style KV and queues).

Tell us about your involvement with the greater Postgres community.

strongDM hears a lot about how its customers use PG and its derivatives (Greenplum, the latest on Aurora, etc.) and we love sharing tips when appropriate.

What new features of PostgreSQL 10 are you most excited about?

As a security product, we're always happy to see security-related upgrades: SASL/SCRAM authentication is a popular option in several of database systems, and is a significant upgrade over the previous salted hashes. We also rely heavily on partitioning, so all related enhancements are welcome.Finally: although we generally wouldn't choose to run parallel queries in a primarily OLTP system, the promise of running analytic queries on a replica (rather than ETL'ing into an analytic database) is very appealing.

What features should be developed/improved and released in the next major upgrade?

Dynamic optimization for queries on partitioned tables. Right now if you run select * from date_partitioned_table where event_timestamp between NOW() and NOW() - interval '7 days'; It scans every partition because the result of NOW() is not knowable ahead of time. But it could optimize that query when it was asked to execute it. Instead of creating a static query plan it could say, I know I'm going to have to compute a list of partitions. So, let's just remember that. Then right before the query runs, it could calculate the list and run the query as though it had been planned with a static date range, and thus only query the affected tables. 

 Why should attendees come to your talk at PostgresConf US 2018?

In this talk, I'll share practical examples of breaches I've personally experienced along with advice on how to hold your vendors accountable, and hopefully make the topic of security a little less intimidating in the process.

What sessions are you most excited about attending at PostgresConf US 2018?

I am looking forward to attending “Reducing the Surface Area of Risk in Data Security” by Tim Gorman and “General Data Protection Regulation (GDPR) with Azure Database for PostgreSQL” by Mark Bolz.

What is your favorite aspect of PostgresConf US?

Being able to network with and learn from a unique community! I’ve found practice to really be one of the best ways to learn about databases.

 What advice would you have for a Computer Science graduate or entry level developer who are interested in learning and engaging with Postgres? 

 I’ve found practice to really be one of the best ways to learn about databases. Get your hands dirty: try breaking things and then fixing them! 

Check out the full schedule for PostgresConf US 2018, and buy your tickets soon!

As part of the countdown to PostgresConf US 2018, learn more about the engaging content and our speakers for this year in our Speaker Spotlight Series.

Hubert Zhang will co-present with Jack Wu at PostgresConf US 2018 on "Customize and Secure the Runtime and Dependencies of Your Procedural Languages using PL/Container." Hubert is a staff software engineer at Pivotal. He received his Master Degree at Peking University, with a major in artificial intelligence. He is most interested in database systems and distributed computing platform.

Tell us about your involvement with the greater Postgres community. (How long have you been involved? How have you contributed? How else would you want to contribute?)

I've been working on Postgres based MPP database Greenplum and HAWQ since 2014. I contributed on PLContainer in Greenplum, data locality, and Ranger module of HAWQ (a SQL-On-Hadoop system).

What features should be developed/improved and released in the next major upgrade?

Vectorize execution for OLAP queries.

Who should attend your talk at PostgresConf US 2018? What would you like for them to take away from your session?

Data scientists and anyone who want to use Python and R in database to do data analysis and machine learning. You'll learn how to use PLContainer as well as how to build a customized docker image to setup your specialized Python or R environment.

Check out the full schedule for PostgresConf US 2018, and buy your tickets soon!

Pavan Deolasse is a PostgreSQL consultant for 2ndQuadrant, one of our Platinum Sponsors for PostgresConf US 2018. Learn more about Pavan in this Community Profile:

Pavan Deolasee is a contributor to the development of PostgreSQL and related technologies. He holds a Masters of Technology in Computer Science from the Indian Institute of Technology, Bombay, and has several publications to his credit.

Pavan was introduced to PostgreSQL in the year 2006 when he started working for a PostgreSQL company. Hacking PostgreSQL was a completely new experience, but by accepting help from the community -- especially Simon Riggs, his mentor -- he began working through the code and was soon working on a very important project (Heap-Only-Tuple aka HOT). It was a very complicated piece of work, yet one of the landmark features in PostgreSQL and to this day remains one of his most important contributions to the project. Pavan has since contributed several patches to PostgreSQL. 

HOT was committed to PostgreSQL in 2008 and Pavan has continued to stay fully engaged with the project. In 2009/2010, alongside other colleagues, Pavan started work on Postgres-XC, a distributed, shared-nothing, clustering solution based on PostgreSQL. He was involved in designing the high-level architecture of the solution, and later wrote many important pieces of the code such as the GTM, the GTM Proxy, the 2PC transaction controller at the coordinator, changes required to guarantee global consistency of the data, and many distributed planner and executor pieces.

When Postgres-XL, a fork of Postgres-XC, was released to the public in 2014, Pavan once again became involved with the project and has been leading the development of Postgres-XL ever since. 

Pavan joined 2ndQuadrant not long after in April 2015, and once again started working with long time colleagues and friends; he and 2ndQuadrant have continued to actively work on the development of Postgres-XL. The focus area of development has been stability and performance of the product while keeping the fork as close to open source PostgreSQL as possible. The most recent release (Postgres-XL 10) supports intra-datanode query parallelism, thus taking distributed query processing to the next level.

In 2013, Pavan and two of his colleagues started the India PostgreSQL User Group. They started conducting small meet-ups, in order to promote the technology in India and bring the local community together. These small gatherings have now expanded with a membership of over 600 members, and into a full scale conference: PGConf India, Asia's largest PostgreSQL conference with more than 250 people in attendance each day in 2018. 

As part of the 2ndQuadrant team of PostgreSQL developers, Pavan continues to work on many interesting new features. He is an active part of the production support team and also has the opportunity to investigate interesting customer problems, often leading to important and critical bug fixes to the open source project.

Pavan had this to say about his involvement with the project:

“I love PostgreSQL and the PostgreSQL community, so you will continue to see me around.”