Where is your path leading you?

At Postgres Conference Silicon Valley I promised during the launch that after the conference was completed PostgresWarrior and I would be taking a freedom tour to various National Parks. 

For us, our path is serving the community through education and professional and personal development. This happens in many forms including these newsletters.

Recent projects have been coordinating a successful webinar series from Yugabyte, creating  online live Postgres instructor lead training, and launching a new educational series on PostGIS. This is all happening while the Call for Papers for Postgres Conference 2020 now open! The ongoing goal is to allow any person to receive the education they need to be successful with People, Postgres, Data year around.

Training

The current training options from Postgres Conference can be found here:

https://postgresconf.org/conferences/Postgres-Digital-Training-Series/schedule/events

We have two performance trainings coming up in October:

• PostgreSQL Performance & Maintenance on October 29th
• Finding and Fixing Slow Queries on October 30th

Both of these training opportunities sell out at the physical conferences. They are solid content and at a reasonable price (149.00 USD ) it is hard to say no to a few hours for education in your day!

Software

Are you frustrated with the limitations and fragility of Logical Replication in PostgreSQL Core? There is a new software on the block called pgcat and it has an impressive list of features to allow your Logical Replication experience to be exceptional.

Looking for a simple script to help find tuning opportunities for PostgreSQL? The perl script postgresqltuner may just be what you are looking for. Yes, there really is an active developer community for the Perl language still.

A HyperLogLog data type for PostgreSQL from our friends at Citus. This Postgres module introduces a new data type hll which is a HyperLogLog data structure. HyperLogLog is a fixed-size, set-like structure used for distinct value counting with tunable precision. For example, in 1280 bytes hll can estimate the count of tens of billions of distinct values with only a few percent error.

Our partner Heimdall Data has been creating a new type of connection pool that removes a significant limitation within other software such as PgBouncer and PgPool. If you are looking for Enterprise Authentication (Active Directory/LDAP) as well as intelligent pooling for many users (and connections), it may be worth a look. There is a webinar next week on how it all works!

Does your path allow people to “Come as you are?”

In consideration of all of the great news from our community we can’t help but reflect on the blessings we have in the world of Open Source. Remember that Open Source is about exceptionalism, creativity, and most importantly freedom. When communities start restricting these three tenets of Open Source, they are no longer Open Source communities, even if their software is.

The theme for Postgres Conference 2020 in NYC is “come as you are” and we are asserting this mantra throughout our entire community. Over the past few years there has been an influx of toxicity throughout all circles and it is time for civility and grace to return. It is time to remember that we are all human. We all have angels and demons to our personalities. We are all flawed and we are all exceptional in our own way.

"But just because I don't agree with someone on everything doesn't mean that I'm not going to be friends with them. When I say, 'be kind to one another,' I don't only mean the people that think the same way that you do. I mean be kind to everyone."

-- Ellen DeGeneres

(Yes, this happened. No, it wasn’t planned.) 

Just outside of Moab Utah.

Find YOUR path.

Come as you are

The theme of Postgres Conference for 2020 is: Come as you are. We want everyone to feel welcome. You are welcome for your love of People, Postgres, Data and a desire to ascend beyond the box. It isn’t about your race, gender, sexuality, political affiliation, or love of blueberry flavored popcorn. It is 100% about you, the creativity and excellence that only you can bring to our community.

Postgres Conference 2020 CFP now open

We are actively seeking content for the largest Postgres Conference in the world, set to be held from March 23rd to 27th, 2020  at the Marriott Marquis, Time Square! Please submit your content here.

Postgres Conference Silicon Valley 2019

Postgres Conference Silicon Valley doubled its attendance, making it the largest Postgres  Conference on the West coast ever! We are very pleased to be able to bring so many community members together for education, fun, and ecosystem support!

Training

• Postgres Conference is now offering live digital training throughout the year. Continuing on our mission of creating exceptional Postgres people, you can now not only register for pre-defined training but request specific training and we will connect you with a class! The current training options are:
• PostgreSQL Performance and Maintenance
• Finding and Fixing slow queries
• Postgres + Kubernetes: yes it really is a match made in heaven
• PostgreSQL Replication deployment and best practices
• PgPool-II Performance and best practices

Register here: https://postgresconf.org/conferences/Postgres-Digital-Training-Series

Digital Events

We have free digital events coming up including topics such as Kubernetes, DistributedSQL, Backups, Postgis and many more. Coming up: 

• Yugabyte Digital Webinar Series.
• Heimdall Data is providing a Webinar on October 22nd on Enterprise Authentication and Connections pooling

Summer is officially over (although the calendar says otherwise), the kids are back in school, the last three-day camping weekend of the season has passed, and we are staring right at PostgresConf Silicon Valley starting September 18th! Registrations for this fantastic event have already exceeded 2018 numbers and our training day is showing great success. 

Conferences

• PostgresConf Silicon Valley 2019, September 18th - 20th, 2019
• PostgresConf South Africa, October 8th - 9th, 2019
• PostgresConf 2020, CFP now open!, March 23 - 27th, 2020

Digital Events

• YugabyteDB Distributed SQL Webinars
• A series of free webinars discussing technical opportunities with Distributed SQL. YugabyteDB is an Open Source, Postgres compatible Distributed SQL database.

News

• Greenplum 6 is now GA
• Building a distributed time-series database on PostgreSQL
• Release v2.1.0 of PgCLI
• Ajqvue Version 3.0, a java-based UI which supports PostgreSQL, released
• PostgreSQL 12 Beta 2 Now Available in Amazon RDS Database Preview Environment

Learn

• PostgreSQL in 4 hours
• Remote backup and restore with PgBackrest
• PgBouncer gets SCRAM!

Partner Conferences

Register Today for API World 2019 and Save $200!

The API World team has offered us 25 free OPEN Passes and discounted PRO Passes to API World 2019 so our members can attend the event.

API World (October 8–10, San Jose Convention Center) is the world’s largest API & Microservices conference and expo with 3,500+ attendees, 60+ exhibitors, and 10+ tracks covering API Lifecycle Management, API Innovations, Microservices, Containers, Kubernetes, and more. 140+ speakers include leaders from Intuit, US Bank, IBM, Okta, Capital One, Box, Kong, GitHub, Comcast, Microsoft, Postman, Twillio, SendGrid, Oracle, Ford, UPS, Uber, Google, eBay and 100+ more. 

GitLab Commit, our premier community event, brings together the GitLab community to connect, learn, and inspire. We want to make sure the NY tech community is well-represented at Commit so we are offering a HUGE discount to members of local tech community groups. You can use code 'COMMITCOMMUNITY102' to save 50%. 

Congratulations

Henrietta Dombrovskaya, Diversity, Equity, and Inclusion member for PostgresConf as well as Chicago Postgresql organizer nominated for Technologist of the Year!

Career Opportunity

A large, well known media company is seeking a Senior Level PostgreSQL Engineer and Architect. This is an on-site engagement, however the company is known to be lifestyle friendly with reasonable working hours, good pay, and benefits. Specific talents requested are the ability to mentor. The location is Seattle, WA. If you are interested in this position please contact randy@neuringerco.com with your resume.

Great content

• Doubling the Sorting Speed of Postgres Network Types with Abbreviated Keys

• Automatically updating Materialized Views

• OrderedAppend: An optimization for range partitioning

Extension Highlight

We wanted to highlight some of the fantastic work that is being done by the ecosystem with Postgres Extensions. Although the base of Postgres is the amazing and extensible PostgreSQL, a lot of users don’t realize that Postgres has the feature they are looking for, if only they were to look to the ecosystem.

Notable Extensions:

• pgaudit : The goal of pgAudit is to provide PostgreSQL users with the capability to produce audit logs often required to comply with government, financial, or ISO certifications.

• pg_credereum : pg_credereum is a PostgreSQL extension that provides a cryptographically verifiable audit capability for a PostgreSQL database, bringing some properties of blockchain to relational DBMS.

• H3-pg : PostgreSQL bindings for H3, a hierarchical hexagonal geospatial indexing system.

Postgres can do what?

There are a ton of Postgres compatible features out there. Some of them are overlooked core features and some of them require installing a different version of Postgres. Here are a few examples:

• TimescaleDB: Time series data management with Postgres

• YugabyteDB: Globally Distributed database with PostgreSQL compatibility

• Postgres-XL: Horizontally partitioned PostgreSQL

• Agensgraph: Graph capabilities with Postgres

• PG-Strom: GPU accelerated extension for Postgres 

Upcoming Education and Networking opportunities:

• PostgresConf Silicon Valley

• PostgresConf South Africa

Interested in attending this year’s conference?

Register for PostgresConf 2019

Interested in an AWESOME international Postgres Conference opportunity? Consider attending PgConf Russia

It is late August, 2019. This is the time where we are usually prepping for the very busy fall season and not much else. However, this is the Year of Postgres and everyone is driving 200MPH down the ecosystem highway (321.8688/KPH). We are going to kick off this newsletter with some exciting information about the community.

Events

PostgresConf has launched Digital Events! The goal of Digital Events is to open our education platform year round to all members of the community. Our first series of events will be held with our ecosystem partner YugabyteDB and their “Distributed SQL Webinar Series.” This is a series of free-to-attend Webinars exploring Distributed SQL from leaders in the field.

PostgreConf Silicon Valley tickets are going at a brisk pace and half day trainings are almost sold out. Register today to reserve your seat before prices go up on September 1st!

Right after Silicon Valley, PostgresConf South Africa is kicking off. This conference has grown by leaps and bounds over the last two years. We highly recommend attending for anyone who can!

PGConf.IN (India) has announced that their conference will be held in February 2020!

Meetups

We have seen the launch of three new meetups this month:

• Los Angeles Postgres The first meetup is planned for late October or early November as we continue to build the Silicon Beach community.
• Toronto Postgres Similar to Los Angeles, the first meetup is planned for late October or early November.
• Charm City Postgres This meetup was formed by long time community member Robert Treat.

Several other meetups are growing quickly: 

• Montreal Postgres has reached a respectable 358 members.
• Vancouver Postgres has reached over 400 members.
• Seattle Postgres has begun to grow again with a new schedule of events!

Interested in speaking or hosting a meetup? Contact us and we’ll connect you with the right people! 

Learn

Here is a short, great introduction tutorial on running PostgreSQL in Docker by Igal Sapir, Los Angeles Postgres organizer. Everybody has 13 minutes.

Shawn Wang from our friends at High Go has provided an insightful write-up on AES Performance.

Ecosystem

TimescaleDB is running a “State of Postgres” survey. Please take five minutes and help them out! They have also announced a new Distributed Timeseries product.

VMWare has just acquired Greenplum and PostgreSQL supporting company Pivotal.

Postgresql.org

PostgreSQL versions 11.5, 10.10, 9.6.15, 9.5.19, 9.4.24, and 12 Beta 3 are now out in the wild and addressing several important security concerns and bug fixes.

---

Have news you’d like included in future newsletters? Contact us.

The PostgresConf team wanted to provide some information on the performance of PostgresConf US 2018 and events over the past year, as well as potentially answer some pending questions. Ultimately our goals are about people, which is why our motto is, "People, Postgres, Data." With each event we hold, each talk we accept, and how we train our volunteers, we make sure people (the benefit for and to), postgres, and data are considered and included. If there is no benefit or consideration to the growth of people, it is not an option.

• Philadelphia 
• Ohio (in combination with Ohio Linux Fest) 
• South Africa 
• Seattle 
• Austin 
• Jersey City (PostgresConf US 2018) 
• Nepal 

PostgresConf US 2018

Logistics

• Days: 5, 2 for training, 3 for Breakout sessions and summits
• Official Attendance #: 601
• Content: Over 207 sessions submitted
• Sessions: Over 108 sessions provided 

Partner Support (Sponsors): 28

Diversity

Professional Growth

We held a Career and Talent Fair. A dozen companies were present to connect with potential employees.

We also held a surprisingly well attended speed mentoring session for potential employees (Especially helpful for many of the WWC) on resumes and interview practices.

Leadership

This year saw the continued elevation of our primary leadership: Viral Shah, Lloyd Albin, Amanda Nystrom, and Debra Cerda. They continued to increase their presence and responsibility within the conference and dedicated hundreds of hours voluntarily to the growth of people. Our international members have also increased their leadership roles with our on-the-ground teams in South Africa and China.

Summits

We had our standard Regulated Industry Summit but also a Greenplum Summit. As I am sure you are aware Greenplum is an Open Source, Postgres based MPP database. They were by far the most popular booth in the entire conference and their summit was very well attended. The relationship with Pivotal and the success of the Greenplum Summit allowed us to learn new ways to bring together the entire Postgres Ecosystem. We expect to run a minimum of 3 more summits at PostgresConf US 2019.

Contribution

We were able to have several excellent (and long) meetings with leaders of Pivotal, Microsoft, Google, and Amazon on how they can begin contributing more back to Postgresql.org. All of them expressed a deep drive to contribute and a desire to learn more about the core community. Of particular note is Google, who would like to contribute the following back to the community:

https://github.com/google/pg_page_verification

We discussed with them the process and various changes they would need to make (license and code style, etc.). We also educated them on the PostgreSQL.Org rigorous review process.

Microsoft is reviewing how they can contribute but they showed an interest in build farm nodes, professional technical writers to help with docs, and potentially code contribution to our Windows port.

International Collaboration

The Chinese Open Source Promotion Union launched the Chinese Postgres Association. We invited them to PostgresConf US and introduced them to the United States Community. We expect great things from the Chinese community in the future.

Future

As we continue to build up our on-the-ground teams, we will likely hold less events in the U.S. this year. We will instead be focused on a smaller number of events in the U.S. and adding events in China and Europe. We have had an amazing amount of support from the Chinese community and the current goal is 1000 attendees for that conference.

Our current plan of events for the U.S. are

• San Jose (October 2018) 
• Philadelphia 
• PostgresConf US (Manhattan) 

Future International Events

• October 2018. 
• Spring of 2019. 
• Spring of 2019. 

This may change as we are actively recruiting on-the-ground teams to help us grow the community.

Collaboration

Our goal is collaboration and growth with other PostgreSQL community and Ecosystem efforts. We want to allow each potential community member to find a home. A place that they feel positive about contributing to the community as a whole. As we continue to grow as a community, it is vital to recognize that each member has their own needs, desires, and return on investment requirement (professional or personal) that they are seeking.

Tidbits of note

• Pivotal went public during PostgresConf US 2018. 
• We (PostgreSQL and PostgresConf) were picked up by ZDNet during the conference
• Another flattering article about PostgreSQL

On DBEngines PostgreSQL is the 4th most popular database but the significance is that of the other 3, we are the only ones that are growing in popularity. 

As part of the countdown to PostgresConf US 2018, learn more about the engaging content and our Diamond and Platinum sponsors for this year in our Sponsor Spotlight Series.

Jacque Istok, is the Head of Data for Pivotal, one of our Diamond Sponsors for PostgresConf US 2018. Pivotal is hosting the first annual Greenplum Summit at PostgresConf US 2018, with lots of great Greenplum and Postgres-related content. Read what Jacque has to say bout Greenplum and Postgres, as well as why to attend the Greenplum Summit: 

Greenplum is an Open Source variant of Postgres; what benefits do you bring to the table over vanilla Postgres?

Postgres is a powerful ORDBMS, but as your data scales, the only way to keep up is to buy bigger and bigger machines to run on. It suffers from the same problems that all SMP databases do: you can only get as big as the machine you’re running on.

With Greenplum you can put a subset of your data on a Postgres database on one reasonably-sized machine, and another subset on a second machine, and so on. All of your users and applications can then query one of these Postgres databases as if all the data was in a single location - making your data scale limitless. Greenplum manages the distribution, data shuffling, and querying of all of your data across a magically sharded implementation of Postgres databases.

Greenplum has its own community; what do you hope to achieve by joining the Postgres community and PostgresConf?

The Postgres community represents some of the most passionate and knowledgeable creators, developers, and users of database technology of our time. We believe that the combination of Postgres and Greenplum becomes the software equivalent of what Oracle Exadata purported to be: an all-purpose database that can do both transactional and analytical workloads across multi-structured data. Simply put, the Greenplum community is looking to join with the Postgres community to further the understanding and adoption of these technologies.

Do you have plans for cross pollination of technologies with the two open source projects?

Greenplum forked from Postgres over 10 years, circa Postgres 8.2. Greenplum 5.0 is based off of Postgres 8.3, with our next major release slated for Postgres 9.4 (current open source Greenplum is compatible with 9.0 as of this writing).

Likewise, we have Postgres committers working at Pivotal looking for opportunities to improve the Postgres code specifically for analytics. We are also ensuring that other projects related to Greenplum, like Apache MADLib, continue to be compatible with Postgres.

What challenges do you see working with the Postgres community as an open source fork?

The Postgres community is a long-running and very passionate group, and we want to be both collaborative and respectful in how we continue to grow our participation. We see the products as having synergies which complement each other very well, with some use cases that best fit Postgres, and others that best fit Greenplum. The use of either benefits the other as they both further adoption.

What would you tell a user who has a choice between Postgres and Greenplum about when they should use which system?

Postgres is a great ORDBMS that will scale to the performance of a single server. For analytical needs, being restricted to a small number of terabytes does not allow for the type of exploration that most organizations need. Because Greenplum is a Postgres compatible database, you can start out using Postgres and either convert to Greenplum underneath or leverage Greenplum alongside your Postgres systems (making data ETL a ton easier). This then makes the choice of which product to use for your particular use case clearer and clearer.

What is the number one barrier you see to contributing to the Postgres community?

The number one barrier we will have to contributing is not seeing the corresponding adoption of our technologies. We feel very strongly that both the transparency and removal of vendor lock-in make our open source commitment the only choice for users. I’m here to implore the community to embrace our technology with zeal and help us continue to drive more and more Postgres adoption in the world.

What is the best thing about working with the Postgres community?

Because Greenplum is based on Postgres, we get to interact with this vast community of talent. We are also able to more seamlessly interact with ecosystem products that already work with Postgres, making the adoption of Greenplum that much easier.

Tell us why you believe people should attend PostgresConf 2018 in April.

PostgresConf is going to be awesome - with both Pivotal and Amazon headlining as Diamond sponsors - as well as the quality of speakers and their content. I wouldn’t miss it for anything.

We’re thrilled to organize the first annual Greenplum Summit at PostgresConf. Greenplum co-founder, Scott Yara, will give a keynote on April 18th relating to how data tells the story at the organizations that we help enable (#DataTellsTheStory), and his journey from SMP to MPP. Greenplum Summit on April 19th will be a full day packed with with great use case sessions and tech talks for novices and experts alike.

Check out the full schedule for PostgresConf US 2018, and buy your tickets soon!

• Mastering PostgreSQL Administration

• Securing Data in a Multi-Platform Data Lake

• Personal Time Management

• Contributing to PostgreSQL