Joshua D. Drake Blog Posts

PGConf US and Austin PUG organized a PGConf Mini last night. It was three presentations over the evening. We had good attendance and excellent community participation. The highlight of the evening was PGConf US Co-Chair Jim Molgendski's presentation, "Top 10 Mistakes When Migrating from Oracle to PostgreSQL".

We tried something new this time around. We utilized Twitter's Periscope capability to live stream his presentation. It wasn't perfect but it was our first time and we are looking forward to utilizing the platform more in the future.

Click here to watch "To Mistakes When Migrating From Oracle to PostgreSQL", and then submit a presentation to one of our upcoming conferences:


PGConf US 2017 - 2018 
  • Diamond Sponsor: Amazon Web Services
  • Platinum Sponsor: OpenSCG

Joshua D. Drake     May 17, 2017

PostgresConf, in partnership with Silicon Valley Postgres, is pleased to announce that the call for papers for PostgresConf Silicon Valley is open.


The inaugural PostgresConf Silicon Valley will be held October 15th - 16th, 2018 at the Hilton San Jose (300 Almaden Boulevard, San Jose, CA 95110).


This two day, three track conference is a perfect opportunity for users, developers, business analysts, and enthusiasts from Silicon Valley and San Francisco to amplify Postgres and participate in the Postgres community.

The Call for Papers for PostgresConf Silicon Valley can be found here

Call for papers will be open from
May 23rd until August 15th. Speakers will be notified of acceptance/decline no later than August 20th.


Conference Schedule at a glance:
  • Monday, October 15th: Trainings and Data track
  • Tuesday, October 16th: Keynotes, Dev and Ops tracks

Partner Opportunities
PostgresConf Silicon Valley is supported by its generous sponsors:

  • Conference Sponsors: Amazon Web Services and Pivotal
  • Premiere Sponsors: Compose, 2ndQuadrant, Timescale, and Microsoft 

Please contact us if you are interested in becoming a partner!


About PostgresConf:
PostgresConf is a global nonprofit conference series with a focus on growing community through increased awareness and education of Postgres and related technologies. PostgresConf is known for its highly attended national conference held in Jersey City, New Jersey with the mission of:



Contact: siliconvalley@postgresconf.org

Joshua D. Drake     May 29, 2018




The presentation includes an introduction and setup for consul as the means of providing highly available PostgreSQL in local and geographically disparate data centers or cloud providers. The presentations includes:

*) Introduction to consul and its architecture
*) Setup of a single consul cluster
*) Setup for a few sample database instances (OLAP and OLTP)
*) Firewall requirements
*) Integration with bind, djbdns, and dnsmasq
*) Setup geographic failover to two different data centers and cloud providers
*) Various Best Practices tips and suggestions
*) Q&A

Joshua D. Drake     April 25, 2017

 
 

As part of the countdown to PostgresConf US 2018, learn more about the engaging content and our Diamond and Platinum sponsors for this year in our Sponsor Spotlight Series.

Jacque Istok, is the Head of Data for Pivotal, one of our Diamond Sponsors for PostgresConf US 2018. Pivotal is hosting the first annual Greenplum Summit at PostgresConf US 2018, with lots of great Greenplum and Postgres-related content. Read what Jacque has to say bout Greenplum and Postgres, as well as why to attend the Greenplum Summit: 

Greenplum is an Open Source variant of Postgres; what benefits do you bring to the table over vanilla Postgres?

Postgres is a powerful ORDBMS, but as your data scales, the only way to keep up is to buy bigger and bigger machines to run on. It suffers from the same problems that all SMP databases do: you can only get as big as the machine you’re running on.

With Greenplum you can put a subset of your data on a Postgres database on one reasonably-sized machine, and another subset on a second machine, and so on. All of your users and applications can then query one of these Postgres databases as if all the data was in a single location - making your data scale limitless. Greenplum manages the distribution, data shuffling, and querying of all of your data across a magically sharded implementation of Postgres databases.

Greenplum has its own community; what do you hope to achieve by joining the Postgres community and PostgresConf?

The Postgres community represents some of the most passionate and knowledgeable creators, developers, and users of database technology of our time. We believe that the combination of Postgres and Greenplum becomes the software equivalent of what Oracle Exadata purported to be: an all-purpose database that can do both transactional and analytical workloads across multi-structured data. Simply put, the Greenplum community is looking to join with the Postgres community to further the understanding and adoption of these technologies.

Do you have plans for cross pollination of technologies with the two open source projects?

Greenplum forked from Postgres over 10 years, circa Postgres 8.2. Greenplum 5.0 is based off of Postgres 8.3, with our next major release slated for Postgres 9.4 (current open source Greenplum is compatible with 9.0 as of this writing).

Likewise, we have Postgres committers working at Pivotal looking for opportunities to improve the Postgres code specifically for analytics. We are also ensuring that other projects related to Greenplum, like Apache MADLib, continue to be compatible with Postgres.

What challenges do you see working with the Postgres community as an open source fork?

The Postgres community is a long-running and very passionate group, and we want to be both collaborative and respectful in how we continue to grow our participation. We see the products as having synergies which complement each other very well, with some use cases that best fit Postgres, and others that best fit Greenplum. The use of either benefits the other as they both further adoption.

What would you tell a user who has a choice between Postgres and Greenplum about when they should use which system?

Postgres is a great ORDBMS that will scale to the performance of a single server. For analytical needs, being restricted to a small number of terabytes does not allow for the type of exploration that most organizations need. Because Greenplum is a Postgres compatible database, you can start out using Postgres and either convert to Greenplum underneath or leverage Greenplum alongside your Postgres systems (making data ETL a ton easier). This then makes the choice of which product to use for your particular use case clearer and clearer.

What is the number one barrier you see to contributing to the Postgres community?

The number one barrier we will have to contributing is not seeing the corresponding adoption of our technologies. We feel very strongly that both the transparency and removal of vendor lock-in make our open source commitment the only choice for users. I’m here to implore the community to embrace our technology with zeal and help us continue to drive more and more Postgres adoption in the world.

What is the best thing about working with the Postgres community?

Because Greenplum is based on Postgres, we get to interact with this vast community of talent. We are also able to more seamlessly interact with ecosystem products that already work with Postgres, making the adoption of Greenplum that much easier.

Tell us why you believe people should attend PostgresConf 2018 in April.

PostgresConf is going to be awesome - with both Pivotal and Amazon headlining as Diamond sponsors - as well as the quality of speakers and their content. I wouldn’t miss it for anything.

We’re thrilled to organize the first annual Greenplum Summit at PostgresConf. Greenplum co-founder, Scott Yara, will give a keynote on April 18th relating to how data tells the story at the organizations that we help enable (#DataTellsTheStory), and his journey from SMP to MPP. Greenplum Summit on April 19th will be a full day packed with with great use case sessions and tech talks for novices and experts alike.

Check out the full schedule for PostgresConf US 2018, and buy your tickets soon!



Joshua D. Drake     March 26, 2018     pivotal Greenplum postgres postgresql

Summer is officially over (although the calendar says otherwise), the kids are back in school, the last three-day camping weekend of the season has passed, and we are staring right at PostgresConf Silicon Valley starting September 18th! Registrations for this fantastic event have already exceeded 2018 numbers and our training day is showing great success. 

Conferences

Digital Events

  • YugabyteDB Distributed SQL Webinars
    • A series of free webinars discussing technical opportunities with Distributed SQL. YugabyteDB is an Open Source, Postgres compatible Distributed SQL database.

News

Learn

 

Partner Conferences

Register Today for API World 2019 and Save $200!

The API World team has offered us 25 free OPEN Passes and discounted PRO Passes to API World 2019 so our members can attend the event.

 

API World (October 8–10, San Jose Convention Center) is the world’s largest API & Microservices conference and expo with 3,500+ attendees, 60+ exhibitors, and 10+ tracks covering API Lifecycle Management, API Innovations, Microservices, Containers, Kubernetes, and more. 140+ speakers include leaders from Intuit, US Bank, IBM, Okta, Capital One, Box, Kong, GitHub, Comcast, Microsoft, Postman, Twillio, SendGrid, Oracle, Ford, UPS, Uber, Google, eBay and 100+ more. 


GitLab Commit, our premier community event, brings together the GitLab community to connect, learn, and inspire. We want to make sure the NY tech community is well-represented at Commit so we are offering a HUGE discount to members of local tech community groups. You can use code 'COMMITCOMMUNITY102' to save 50%. 

 

Joshua D. Drake     September 04, 2019

What is the future of Postgres?

When you observe the ecosystem you can’t help but ask yourself where the community and software is going next. It is without question that the future of data will reside in something Postgres. It may be PostgreSQL, Cockroach, Yugabyte, Aurora, Azure, or workload specific Postgres such as Greenplum. Based on the sheer number of successful software adventures that are based on Postgres, there is no doubt in our minds that it is the future. 

This is why the inclusivity of People, Postgres, Data is vital to the continued success of the community. It is also why we invite all of Postgres to Come As You Are from March 23rd - 27th, 2020 at the Marriott Marquis in Manhattan! 

Isn’t Postgres, PostgreSQL?

Yes, and no. It is true that the term Postgres is sometimes used as a short version of PostgreSQL which allows easier pronunciation of the project and software name. It is also true that PostgreSQL contains a great deal of Postgres code but it is not technically Postgres. In fact, Postgres predates PostgreSQL by quite a few years and had an interim fork called Postgres95 before the PostgreSQL project was founded. That is why we use Postgres as an inclusive term for all software Postgres including many that some would consider forks. Fun fact:  Did you know that Informix is based on Illustra, a commercial Postgres fork from 1997?

Call for Papers

We are actively seeking people to deliver exceptional educational opportunities at Postgres Conference 2020. Postgres Conference is the perfect opportunity for students, hobbyists, and professionals to exhibit their knowledge in solving problems that are People, Postgres, or Data related. Submit your proposal today.

Instructor lead Digital Training

We have the following training opportunities in November and December:

  • November 12th: PostgreSQL Performance and Maintenance
  • November 14th: Finding and Fixing Slow Queries in PostgreSQL
  • November 21st: PostgreSQL and Kubernetes
  • December 10th: PostgreSQL Replication deployment and best practices
  • December 12th: PGPool-II: Performance and best practices

Register here.

Webinars

We have the following webinars in November:

  • Nov 13: Designing a Change Data Capture and Two Data Center Architecture for a Distributed SQL Database
  • Nov 14: Yugabyte DB 2.0 Jepsen Test Results and Distributed Transactions Algorithms in Google Spanner, YugabyteDB and CockroachDB
  • Nov 20: Zero Down-Time Oracle to Cloud-Native PostgreSQL Migrations

Find more information here.

Interesting projects

  • http://postgrest.org/en/v6.0/ PostgREST is a standalone web server that turns your PostgreSQL database directly into a RESTful API. The structural constraints and permissions in the database determine the API endpoints and operations.
  • https://www.haproxy.org/ HAProxy is a free, very fast and reliable solution offering high availability, load balancing, and proxying for TCP and HTTP-based applications. It is particularly suited for very high traffic web sites and powers quite a number of the world's most visited ones. Over the years it has become the de-facto standard opensource load balancer, is now shipped with most mainstream Linux distributions, and is often deployed by default in cloud platforms. Related content.

 

Joshua D. Drake     November 07, 2019

We are having yet another PGConf Mini in NYC. The event is scheduled for December 14th, 2017 and Work Bench is hosting:

 
 
The event is part of the PGConf Mini series and is free to attend. The PGConf Mini series works directly with user groups and external communities to organize events for the local community. The events are held as a larger meetup style event with networking opportunities and up to 4 presentations. The current agenda for the latest PGConf Mini: NYC is:
 
Agenda: 
 
• 6:30 - 7:00: Jonathan Katz, (TBD), Postgresql Contributor and PGConf Chair Emeritus

Efficiently and Safely Propagate Data Changes Without Triggers!

 

Prior to PostgreSQL 9.4, the primary way to distribute data-driven changes across multiple tables was to use triggers. While triggers guarantee that these changes will be propagated, they can have a significant impact application performance, both technically and with development time (see: "debugging"). PostgreSQL 9.4 introduced logical decoding, which provides a way to stream all changes in a database to a consumer. Using a logical decoder, you can read all changes that are made in a table into your programming language of choice to perform many tasks: cache invalidation, data propagation, submitting changes to remote services, and more. Many PostgreSQL drivers, such as psycopg2 and JDBC support the logical replication protocol, which lets you easily stream your database changes to be manipulated using your favorite programming language. This talk will demonstrate how you can setup logical decoding for your application, look at architecture strategies for working with a logical decoder, and look at a case-study that shows how using logical decoding led to a big performance boost over a similar trigger-based system.
 
• 7:00 - 7:30:  Kevin Jernigan, Senior Product Manager, Amazon
Technical Architecture of Postgres Aurora 
 
Amazon Aurora is a cloud-optimized relational database that combines the speed and availability of high-end commercial databases with the simplicity and cost-effectiveness of open source databases. The recently announced PostgreSQL-compatibility, together with the original MySQL compatibility, are perfect for new application development and for migrations from overpriced, restrictive commercial databases. In this session, we’ll do a deep dive into the new architectural model and distributed systems techniques behind Amazon Aurora, discuss best practices and configurations, look at migration options and share customer experience from the field. 
 
• 7:30 - 8:20: Joshua (JD) Drake POSTPONED due to flight cancellation)
The Power of Postgres Replication, Postgres Expert - Lead Consultant Command Prompt, Inc and Co-Chair PGConf!
 
With PostgreSQL v10 a new replication engine has come to town. Let's explore Postgres Logical Replication, how to use it, optimize it and let it best fit in with your organization. We will also discuss its interactions with external tools as well as Binary Replication and features such as Hot Standby. 
 
 
 
 
Joshua D. Drake     November 20, 2017

PGConf US in partnership with the Austin PostgreSQL User Group (AUSPUG) is pleased to announce that the call for papers for PGConf Local: Austin is now open.


AUSTIN, June 28, 2017 -- The inaugural PGConf US Local: Austin Conference (PGConf Austin) will be held November 3 - 4, 2017, at the Norris Conference and Event Center (2525 W. Anderson Ln #365, Austin, TX 78757) located in northwest Austin.


This two day, multi track conference is a perfect opportunity for users, developers, business analysts and enthusiasts from the Southwest to amplify Postgres and participate with the Postgres community.
The Call for Papers for PGConf Austin is now open, and presentation proposals can be submitted at https://pgconf.us/conferences/Austin2017

The call for papers for PGConf Austin will be open until Sunday, August 20, 2017, and speakers will be notified of acceptance/decline no later than Monday, August 28, 2017. Registration for PGConf Austin will also open August 28.

Conference Schedule:
  • Friday, November 3, 2017: Half-day Trainings with Postgres experts
  • Saturday, November 4, 2017: Breakout Sessions (lunch and coffee break provided)


Conference speakers receive complimentary entry to the breakout sessions on November 4 -- the half-day trainings are separately priced sessions. As a nonprofit event series, funding is currently not available for speaker travel and lodging accommodations. Everyone is encouraged to submit a talk or training to the first PGConf supported nonprofit educational events in Texas, and join the growing PostgreSQL community.
Sponsorship Opportunities
PGConf Local series is supported by its generous sponsors, including Diamond Sponsor Amazon Web Services and Platinum Sponsors 2ndQuadrant, Compose, and OpenSCG, as well as Media Sponsor AmplifyPostgres. Business leaders and companies interested in sponsoring PGConf US nonprofit events can view the Conference Prospectus .


About PGConf US:
PGConf US is a nonprofit conference series with a focus on growing the Postgres community through increased awareness and education of Postgres. PGConf US is known for its highly attended national conference held in Jersey City, New Jersey, each year, and has expanded to a local series for 2017.


The PGConf Local series partners with local Postgres and open source groups to bring dynamic and engaging Postgres related content and professional training experience to their local communities in major metroplexes. 2017 host cities include Philadelphia, Seattle, and Austin, as well as Internationally in South Africa with more locations to follow.


Media Contact: organizers@pgconf.us

Joshua D. Drake     June 28, 2017



PGConf US in conjunction with NYCPUG is pleased to present PGConf US Mini: NYC on September 14th, 2017. The doors open at 6:30PM and there will be three presentations as well as food, beverages and networking opportunities. Join the community in supporting this great no cost for attendance opportunity.



The following is a list of the Postgres content that will be presented:
  • Partitioning in Postgres v10 by Corey Huinker
  • Building a scalable time-series database on PostgreSQL by Mike Freedman
  • Major Features: Postgres 10 by Bruce Momjian
You can find full details at the PGConf US Mini: NYC website.
These events wouldn't be possible without the great support from our sponsors:

PGConf US Mini events are designed to bring an evening of high quality presentations to the local user groups. They are great opportunities to learn, network and socialize. If your community would like to join us in bringing a mini to your local community get in touch!

Joshua D. Drake     August 24, 2017

In 2016 we started working with horizontal communities. We wanted to make sure that PgConf US was an inclusive community that advocated not only for the best database in the world but also all the external Open Source technologies that make the best database in the world the best platform in the world. 

This year we wanted to continue building a stronger community through relationships and our efforts are proving successful. We have joined forces with several horizontal communities to bring original and related content to PgConf US. The first is Big Apple Py. They are working with PgConf US to run a full track of Python content as well as a development workshop. 


The workshop is particularly interesting as it will focus on a code sprint to develop a mature and user friendly Python based conference software. I wonder if they know we already use a Ruby on Rails solution...

We also have a great workshop being presented by DockerNYC and Jesse White: Automating production ready databases in Docker
DockerNYC
PgConf US 2017 is less than two weeks away and we continue to work with communities to bring you even more new content! Stay tuned as we expect to announce more workshops in the next few days. If you haven't purchased your tickets, today would be a good day.
Joshua D. Drake     March 15, 2017