Joshua D. Drake Blog Posts

PostgresConf US 2018 is in 9 days. Here is the obligatory "Buy your tickets" reminder! If you look around (a Google search of Gold sponsor Google Cloud is a good place to start) you will find a lot of discount codes.

In 2017 we launched a community wide effort to better recognize contributors for not only the conference but the wider Postgres Community. We continued this effort in 2018 and are pleased to have many speaker profiles available, with more being published every day:

As one of the Chairs of PostgresConf, I am honored by the resounding support from sponsors, speakers, and volunteers to help create a fantastic event for all attendees. It has been a pleasure working toward the common goal of creating a global, non-profit, Postgres Conference series.
 
 
 
 




The presentation includes an introduction and setup for consul as the means of providing highly available PostgreSQL in local and geographically disparate data centers or cloud providers. The presentations includes:

*) Introduction to consul and its architecture
*) Setup of a single consul cluster
*) Setup for a few sample database instances (OLAP and OLTP)
*) Firewall requirements
*) Integration with bind, djbdns, and dnsmasq
*) Setup geographic failover to two different data centers and cloud providers
*) Various Best Practices tips and suggestions
*) Q&A

Joshua D. Drake     April 25, 2017

 
 

As part of the countdown to PostgresConf US 2018, learn more about the engaging content and our Diamond and Platinum sponsors for this year in our Sponsor Spotlight Series.

Jacque Istok, is the Head of Data for Pivotal, one of our Diamond Sponsors for PostgresConf US 2018. Pivotal is hosting the first annual Greenplum Summit at PostgresConf US 2018, with lots of great Greenplum and Postgres-related content. Read what Jacque has to say bout Greenplum and Postgres, as well as why to attend the Greenplum Summit: 

Greenplum is an Open Source variant of Postgres; what benefits do you bring to the table over vanilla Postgres?

Postgres is a powerful ORDBMS, but as your data scales, the only way to keep up is to buy bigger and bigger machines to run on. It suffers from the same problems that all SMP databases do: you can only get as big as the machine you’re running on.

With Greenplum you can put a subset of your data on a Postgres database on one reasonably-sized machine, and another subset on a second machine, and so on. All of your users and applications can then query one of these Postgres databases as if all the data was in a single location - making your data scale limitless. Greenplum manages the distribution, data shuffling, and querying of all of your data across a magically sharded implementation of Postgres databases.

Greenplum has its own community; what do you hope to achieve by joining the Postgres community and PostgresConf?

The Postgres community represents some of the most passionate and knowledgeable creators, developers, and users of database technology of our time. We believe that the combination of Postgres and Greenplum becomes the software equivalent of what Oracle Exadata purported to be: an all-purpose database that can do both transactional and analytical workloads across multi-structured data. Simply put, the Greenplum community is looking to join with the Postgres community to further the understanding and adoption of these technologies.

Do you have plans for cross pollination of technologies with the two open source projects?

Greenplum forked from Postgres over 10 years, circa Postgres 8.2. Greenplum 5.0 is based off of Postgres 8.3, with our next major release slated for Postgres 9.4 (current open source Greenplum is compatible with 9.0 as of this writing).

Likewise, we have Postgres committers working at Pivotal looking for opportunities to improve the Postgres code specifically for analytics. We are also ensuring that other projects related to Greenplum, like Apache MADLib, continue to be compatible with Postgres.

What challenges do you see working with the Postgres community as an open source fork?

The Postgres community is a long-running and very passionate group, and we want to be both collaborative and respectful in how we continue to grow our participation. We see the products as having synergies which complement each other very well, with some use cases that best fit Postgres, and others that best fit Greenplum. The use of either benefits the other as they both further adoption.

What would you tell a user who has a choice between Postgres and Greenplum about when they should use which system?

Postgres is a great ORDBMS that will scale to the performance of a single server. For analytical needs, being restricted to a small number of terabytes does not allow for the type of exploration that most organizations need. Because Greenplum is a Postgres compatible database, you can start out using Postgres and either convert to Greenplum underneath or leverage Greenplum alongside your Postgres systems (making data ETL a ton easier). This then makes the choice of which product to use for your particular use case clearer and clearer.

What is the number one barrier you see to contributing to the Postgres community?

The number one barrier we will have to contributing is not seeing the corresponding adoption of our technologies. We feel very strongly that both the transparency and removal of vendor lock-in make our open source commitment the only choice for users. I’m here to implore the community to embrace our technology with zeal and help us continue to drive more and more Postgres adoption in the world.

What is the best thing about working with the Postgres community?

Because Greenplum is based on Postgres, we get to interact with this vast community of talent. We are also able to more seamlessly interact with ecosystem products that already work with Postgres, making the adoption of Greenplum that much easier.

Tell us why you believe people should attend PostgresConf 2018 in April.

PostgresConf is going to be awesome - with both Pivotal and Amazon headlining as Diamond sponsors - as well as the quality of speakers and their content. I wouldn’t miss it for anything.

We’re thrilled to organize the first annual Greenplum Summit at PostgresConf. Greenplum co-founder, Scott Yara, will give a keynote on April 18th relating to how data tells the story at the organizations that we help enable (#DataTellsTheStory), and his journey from SMP to MPP. Greenplum Summit on April 19th will be a full day packed with with great use case sessions and tech talks for novices and experts alike.

Check out the full schedule for PostgresConf US 2018, and buy your tickets soon!



Joshua D. Drake     March 26, 2018     pivotal Greenplum postgres postgresql

Announcing PostgresConf Silicon Valley 2019, September 18th - 20th at the Hilton San Jose! An absolute perfect pairing of training, breakout sessions, and a fantastic weekend break to enjoy the valley for every speaker, attendee, volunteer, and organizer. 

Didn't you just host the community at PostgresConf Silicon Valley, you ask? Why yes we did! That event was October 15th and 16th of 2018. The event was such an unexpected success that we immediately started working with the hotel to lock in our dates for 2019. We requested mid-October to early November. Unfortunately, the only week they had available was the week of September 15th, 2019. We are again working with the Silicon Valley Postgres Meetup; the fastest growing Postgres meetup in the United States. 

As we continue to be the fastest growing, non-profit, inclusive, and volunteer organized event we are providing you the breakdown of the Silicon Valley 2018 financials:


PostgresConf Silicon Valley is much more cost effective than the "big" conference in Manhattan and that is exactly what we want as a development or "local" conference. We are targeting 50% growth for 2019 and we want do so in a way that is inviting to new community members that won't overwhelm them. We succeeded with that in 2018 and we are going to continue the mission of People, Postgres, Data!

The global non-profit Postgres Conference Series


Joshua D. Drake     November 14, 2018

PostgresConf Beijing 2019

Join our Mailing List | Attend one of our events |

Last week was PostgresConf Beijing 2019. This event was an exercise in people understanding what it truly takes to run a conference. It was a standalone event unlike PostgresOpen China in 2018 which always takes a lot more work. We had generous sponsor support with the likes of Microsoft, Amazon Web Services, IBM, Pivotal, Inspur, HighGo, Credativ, and Command Prompt.

The overarching theme of the conference was of course People, Postgres, Data and we had many (translated) conversations about how Postgres can be the center of your Data Universe and how the ecosystem thrives with not only PostgreSQL but also technology such as TimescaleDB and Yugabyte. All of which are Open Source and enable People to use Postgres to manage their Data. In 2020, the plan is to have PostgresConf China in October or November. The timing will allow for a more moderate climate as well as have more time to generate international content.

English As A Second Language

As we continue to work with English-as-a-second-language communities we continue to find opportunities for them to grow and contribute. Of course the most common (and possibly difficult) opportunity is that in order to contribute code to PostgreSQL.Org, you must speak English. This is not an unreasonable requirement as English is the language of Computer Science.

A common piece of feedback we received was not that English was the consideration but the “level” of English proficiency was high. Unfortunately, verbosity is not always productive and it is certainly counterproductive when the vocabulary doesn’t take into account the non-native speaker. It would be a boost to productivity if we as a community tried to be succinct and as uncomplicated as reasonable in our communication. To put this another way and from a far more qualified source than us:

“Don't use a five-dollar word when a fifty-cent word will do.”

-- Mark Twain

Contribution Opportunities

While encouraging the Chinese community to contribute we continued to look for the low barrier of entry tasks. The obvious opportunity is translation of various project documentation. That is not the only prospect as PostgreSQL has fantastic extensibility and suggestions of developing new extensions. Contributing directly to PostgreSQL code has a high barrier of entry between English as a second language and overall overhead in building comprehensive knowledge of the core code. Extensions in contrast generally require needing to understand narrow areas of code to build a feature that is user-need specific. We are still exploring these opportunities but one option would be to invite extension authors to work with regional communities for translation or feature work.

Software You Weren’t Aware Of

Oleg from PostgresPro and PGConf.Russia was present and we were able to have some great conversations about the work they are doing, most of which can be found on Github. Although there is a lot of great software in that repository, the one that grabbed my eye as immediately useful was Zson. Zson is an extension that allows native compression of JSON/JSONB documents, greatly reducing disk space usage and increasing query speed of documents.

Please Replace IRC and Slack

Further conversations were had on how we can build a modern collaboration community that is internationally inviting, supports all languages, and is built on Open Source technologies. Initially it seems that Mattermost is a good contender but after further research it seems that we should also consider Matrix.org. The idea has barriers as the Chinese are partial to WeChat and the Professional U.S. community has left IRC for Slack, whereas other communities such as Brazil and Russia have settled on Telegram. We have a community member based working group determining next steps.

You may say that I'm a dreamer

But I'm not the only one

I hope someday you'll join us

And the world will be as one

-- John Lennon

Looking Forward

As People, Postgres, Data and PostgresConf continues to move forward we are looking forward to building on existing initiatives and events. We have PostgresConf Philly next week, PostgresConf Silicon Valley in September, and our next International event in October with PostgresConf South Africa. We are also continuing to work on our Inclusivity, Equit,y and Diversity initiative and launching Digital Events! This doesn’t include the growing number of meetups joining the idea of People, Postgres, Data including NYC Postgres, Silicon Valley Postgres, Philly Postgres, Seattle Postgres, and Montreal Postgres!

Quote of the week

“Those pig ears are really good.” -- Michael Meskes, Credativ and Postgresql.org committer.

Joshua D. Drake     July 11, 2019     #postgres #postgresconf

Due to a rise in concern around the Omnicron variant of COVID-19 and surprise remodeling/construction from the Hilton, Postgres Conference Silicon Valley 2022 has been rescheduled. The hotel has been apologetic and accommodating. The new dates for the conference are:

April 7-8 (Thursday - Friday)

Though this was an unexpected decision, we are confident that the delay of the event will result in a positive outcome for all involved.

Thank you for your support!

Get your tickets here.

Joshua D. Drake     January 05, 2022

 

Image result for seattle hd wallpaper


It is with great pleasure that we announce the final program for PGConf Local: Seattle. The schedule is still being hammered out but we have finalized the content that will be presented. Please join us in celebrating Postgres in Seattle!

 
The conference is the first Postgres event to be held in Seattle since 2009 and we have received a lot of positive feedback from the local Postgres and Data communities. Clearly Postgres has been missed in the Emerald City!
 
Training Options:
Breakout Sessions:

Track: Ops

  • Develop intelligent apps on the Azure platform using the Azure Database for PostgreSQL by Sunil Kamath
  • Tuning PostgreSQL for High Write Workloads by Grant McAlister
  • POSTGRESQL V10: AN AMPLIFIED VERSION OF POSTGRES by Joshua D. Drake
  • Enterprise Data Architecture with PostgreSQL by Kevin Kempter
  • All the dirt on Vacuum by Jim Nasby
  • Building a scalable time-series database on PostgreSQL by Matvey Arye

Track: Dev

  • Semantic Search Web System on PostgreSQL by QUAN-HA LE
  • Increase Application Performance with SQL Auto-Caching; No Code Changes by Roland Lee
  • Introduction to JavaScript Stored Procedures by Jim Mlodgenski
  • Under the hood: API integrations and more in an energy efficiency PostgreSQL + Django application by Jennifer Scheuerell
  • Using GIS in PostgreSQL by Lloyd Albin

Tracks: Big Data, Data Science and AWS/Cloud

  • With Great Power Comes Great Responsibility by Michael Sacks
  • Data Quality Expert Is Not Harvard's Sexiest Job...But... by Ben Rogojan
  • GRAKN.AI: the hyper-relational database for knowledge-oriented systems by Haikal Pribadi
  • Best Practices with Managed PostgreSQL in the Cloud by Jignesh Shah
PGConf Local: Seattle is made possible by the wonderful team of volunteers including the Seattle Postgres User Group and our sponsors:
 
 
Diamond2
 
Platinum: Compose.IO, OpenSCG, 2ndQuadrant, and Microsoft
Joshua D. Drake     October 19, 2017

 

At Postgres Conference we are always optimizing our People, Postgres, Data experience, and as more events move to Digital,  we have worked hard to perfect that collaborative experience for our community. The hard work of our volunteers has paid off, our content is top notch, and our participant account is consistently high.

 

With a now-proven track record, we are pleased to announce that we are accepting Community and Commercial presentations via the Postgres Webinar Series Call for Presentations through the end of 2020. If your presentation is accepted we will contact you directly to arrange an appropriate time to deliver your content.

Recent awesome news

KDE, arguably the most complete desktop experience for Linux, is now hosted on a private instance of Gitlab. As is proper, Gitlab only supports Postgres as the backend database.

For those who who love #FarmFresh or #farmtotable, there is a new website that showcases Farms that are delivering. It was developed using React, Rails, and Postgres. 

Upcoming Digital Events

  • July 7, 10am PT: Deep Dive into PostgreSQL Indexing

A Deep Dive into PostgreSQL Indexing

  • July 15, 10AM PT: Working with JSON Data in PostgreSQL vs. MongoDB

Working with JSON Data in PostgreSQL vs. MongoDB

Previous Digital Events:

The International Postgres conference  series continues to grow! PGConf APAC 2018 is the latest PGConf.Org addition.

Following the success of two consecutive pan-Asia Postgres event - pgDay Asia 2016 and pgDay Asia 2017 held along with FOSSASIA, we are pleased to announce PGConf APAC 2018 to be held in Singapore from 22nd to 24th of March, 2018. Once again the conference will be held along with FOSSASIA - one of the largest FOSS conference on the planet. PGConf APAC will be PostgreSQL conference series for all PostgreSQL enthusiasts and users in the Asia Pacific region.
For more details on FOSSASIA - http://2018.fossasia.org
You will be able to enjoy one of the largest PostgreSQL conference in Asia and one of the largest FOSS conferences to meet like minded individuals in the same week!
pgDay Asia 2016 and pgDay Asia 2017 would not have been possible without your awesome talks and we would like to invite speakers from all over the globe to present at the PGConf APAC 2018. We would like to open Call For Paper for PGConf APAC 2018. Some of the topics which can be used for submitting a talk are-
  1. Migration projects
  2. Performance troubleshooting and tuning
  3. noSQL and geo-spatial features of Postgres
  4. Unique use-case and customer stories
  5. Useful new features in PostgreSQL 10
For more examples you can refer to the papers which were presented at last year's event - 2016 and 2017.
Of course we are happy to accept paper proposals on any other interesting topics as well.
To submit you proposal for presentation please go to this link - http://2018.pgconfapac.org/cfp
Venue
To be Announced
Call for Papers
2017-10-10: Proposals acceptance begins
2017-12-04: Proposals acceptance ends
2017-12-13: Authors of accepted proposals contacted
If you need any additional information please contact our team at pgconfapac(at)googlegroups(dot)com.
This conference is organized by the PostgreSQL people from Asian communities. If you have any question, feel free to contact us on pgconfapac(at)googlegroups(dot)com.
For sponsorship related queries please get in touch with our team at apac-organizer(at)pgconf(dot)org.
Joshua D. Drake     October 10, 2017

Silicon Valley Postgres and PostgresConf Silicon Valley are happy to announce that early bird tickets are now available! You can purchase them here. You will want to hurry as early bird discounted tickets are only available until September 1st, 2018.

PostgresConf Silicon Valley takes place on October 15th and 16th, 2018 at the Hilton San Jose. The schedule is not finalized. However, we have a comprehensive list of content from technical leaders in the Postgres ecosystem we are reviewing. Here is a brief list of some (but not all!) of the topics to be presented:

  • Postgres 11
  • Data integrity at scale
  • Distributed data and GPDR
  • Massively Parallel Postgres for Analytics
  • Data intersection between roles
  • RDS tips and tricks
  • I didn’t know Postgres could do that!
  • Performant time-series data management analytics
The Silicon Valley schedule is expected to be published this week and we are looking forward to seeing you all in October!

PostgresConf is organized by an all volunteer team of fantastic individuals and is backed by a 501c3 non-profit. The Silicon Valley conference provides the most cost effective avenue to learn all about Postgres and the Postgres ecosystem. We invite everyone to enjoy our expertly delivered presentations, good food, the hallway track and the opportunity to learn, network and appreciate everything that is Postgres.

Joshua D. Drake     August 21, 2018