Joshua D. Drake Blog Posts

PostgresConf hopes everyone had a great holiday season and we hope everyone has a fantastic 2019.

With January upon us, we start conference season. This year, PostgresConf 2019 will be in NYC at the Sheraton New York Times Square March 18-22, 2019.

If you have a story about lessons learned with Postgres, a cool feature that you've found a creative way of using, or just some practical knowledge you'd like to share with your fellow Postgres users, submit a talk. Remember, there are many people who are new to Postgres, so introduction levels talks are welcome. The CFP ends this Friday so get your talks submitted soon at:
https://postgresconf.org/conferences/2019#callforpapers

Also, the Early Bird window for PostgresConf 2019 will be ending next Friday, January 18. This tickets are pretty substantially discounted if you purchase them early. On top of the Early Bird discount, for being a member of the NYC Postgres User Group, there is a promo code for an additional 15% off. Just use the code 2019_PUG_NYC when buying your tickets.
Lastly, if you are already in the NYC area we look forward to seeing the community at the Winter Party on the 10th!
We hope to see you at PostgresConf 2019 and remember:



Joshua D. Drake     January 09, 2019

Pivotal Sponsor Highlight Blog for PostgresConf 2019

 

Written by:

Jacque Istok, Head of Data, Pivotal

 

1. Greenplum has its own community; what do you hope to achieve by joining the Postgres community and PostgresConf?

Both interest and adoption of Postgres have skyrocketed over the last two years, and we feel fortunate to be a part of the extended community. We have worked very hard to uplevel the base version of Postgres within Greenplum to more current levels and to be active in the Postgres community. We see Greenplum as a parallel (and analytic focused) implementation of Postgres, and we encourage the community to continue to embrace both the technology and the goal of the Greenplum project, which is Postgres at scale.

 

2. Are you planning to provide any new tech (PG features, etc.)?

This year we plan to announce several new things for both Greenplum and Postgres. We’re introducing new innovations in our cloud offerings in the marketplaces of AWS, Azure, and GCP. We also have major news about both our natural language at-scale analytics solution based on Apache Solr, and our multi-purpose machine learning and graph analytics library Apache MADlib. The next major release of Greenplum is a major focus as well, differentiating Greenplum from each of its competitors and bringing us ever closer to the latest versions of Postgres.

 

3. Are there any rising stars in the community you’d like to give props to?

While it seems a little self-serving, I would like to take the opportunity to give props to the Pivotal Data Team. This team is a 300+ worldwide organization that helps our customers, our prospects, and the community to solve real world and really hard data problems—solved in part through Postgres technology. They all attack these use cases with passion and truly make a difference in the lives of the people that their solutions touch. I couldn’t wish to work with a finer group.

 

4. What is the number one benefit you see within Postgres that everyone should be aware of?

The number one benefit of Postgres is really its flexibility. This database chameleon can be used for SQL, NoSQL, Big Data, Microservices, time series data, and much more. In fact, our latest analytic solution, MADLib Flow, leverages Postgres as an operational engine. For example, Machine Learning models created in Greenplum can be pushed into a restful API as part of an agile continuous integration/continuous delivery pipeline easily and efficiently—making Postgres the power behind what I still like to think of as #DataOps.

 

5. What is the best thing about working with the Postgres community?

 

I deeply admire the passion and consistency of the community behind Postgres, constantly and incrementally improving this product over decades. And because Greenplum is based on Postgres, we get to interact with this vast community of talent. We are also able to more seamlessly interact with ecosystem products that already work with Postgres, making the adoption of Greenplum that much easier.

 

6. Tell us why you believe people should attend PostgresConf 2019 in March.

 

PostgresConf is going to be awesome, and I can’t wait for it to start! With Pivotal, Amazon, and EnterpriseDB headlining as Diamond sponsors, Greenplum Summit (along with multiple other summits), and high-quality speakers and content across the board, this year’s PostgresConf promises to be bigger and better than ever and surely won’t disappoint.

 

We’re thrilled to be back to present the second annual Greenplum Summit on March 19th at PostgresConf. Our theme this year is “Scale Matters”, and what we’ve seen with our customers is that every year it matters more and more. Our users are part of organizations that are generating tons of data and their need to easily and quickly ingest and interrogate all of it is paramount. This is true even more now than ever before as the insights that can be found not only help differentiate them from their competitors, but are also used to build better products and increase customer loyalty.

 

The day will be filled with real-world case studies from Greenplum users including Morgan Stanley, the European Space Astronomy Centre, Insurance Australia Group, Purdue University, Baker Hughes (a GE company), Conversant, and others, plus presentations and deep-dive tech sessions for novices and experts alike.

Joshua D. Drake     February 14, 2019

After National 2017, the PGConf US team decided to take a long hard road to bring the best in educational content and advocacy to the entire Postgres ecosystem. Today, we welcome 2ndQuadrant as a Platinum sponsor and thank them for helping us with our year over year projects.


2ndq logo color no cross

It is sponsors like 2ndQuadrant that are allowing us to achieve our goal of having not only our National event but Philly, Seattle, and Austin all within 2017. We also have other education and advocacy initiatives that continue to develop include webinars, community profiles, and e-training. Stay tuned for more information on those!

Other PGConf US news:


Joshua D. Drake     June 29, 2017

Image result for hyatt regency columbus ohio

PGConf US, in partnership with Ohio Linux Fest, is pleased to announce the schedule PGConf Local: Ohio is now available.

The inaugural PGConf US Local: Ohio Conference (PGConf Ohio) will be held September 29th - 30th at the Hyatt Regency Columbus Ohio (350 North High Street Columbus, Ohio, USA43215).

This two day, single track conference is a perfect opportunity for users, developers, business analysts, and enthusiasts from Ohio to amplify Postgres and participate in the Postgres community.


Conference Schedule:


Image result for bruce momjian
Mastering Postgres Administration: Bruce Momjian

Image result for Joshua D. Drake postgres

Conference speakers receive complimentary entry to the breakout sessions on September 30th as well as attendance to Ohio Linux Fest as well. The half-day training options on September 29th are separately priced sessions. As a nonprofit event series, funding is currently not available for speaker travel and lodging accommodations.


Sponsorship Opportunities
The PGConf US Local series is supported by its generous sponsors: Diamond Sponsor Amazon Web Services and Platinum Sponsors Compose, 2ndQuadrant, and OpenSCG. Please contact us if you are interested in joining our wonderful sponsors for Ohio or National!

About PGConf US:
PGConf US is a nonprofit conference series with a focus on growing the community through increased awareness and education of Postgres. PGConf US is known for its highly attended national conference held in Jersey City, New Jersey, and has expanded to a local series for 2017.

The PGConf Local series partners with regional Postgres and open source groups to bring dynamic and engaging Postgres related content and professional training experiences to local communities. Host cities of 2017 include Philadelphia, Ohio, Seattle, Austin, and Cape Town, South Africa, with more locations to follow.

Contact: organizers@pgconf.us
Joshua D. Drake     August 30, 2017

2ndQuadrant Sponsor Highlight Blog for PostgresConf 2019

 As part of the countdown to PostgresConf US 2019, learn more about about featured Platinum Sponsor 2ndQuadrant, including their commitment to partnering with and contributing to the Postgres community.

 

Tell us about the recent uptick in Oracle to Postgres migrations.

Licensing costs of Oracle is a significant factor for businesses looking to migrate towards PostgreSQL. Not only is PostgreSQL a more cost effective solution, but it provides enterprise-level capabilities and customization options. The increasing demand for migration services from Oracle to PostgreSQL can also be attributed to the availability of PostgreSQL in the cloud.

 

Where do you see the Postgres market going?

PostgreSQL has been gaining traction with every release; interest and usage by large enterprises worldwide is growing exponentially due to the robust capabilities it provides. 2ndQuadrant intends to continue their active contributions in development and supports the overall growth of PostgreSQL.

 

 Do you have any big wins this year?

2Q PGConf 2018 had a successful second year bringing together PostgreSQL developers and users. Both speakers and attendees enjoyed the combination of technical and use case topics as well as the diverse range of networking opportunities. 

Sri Rangarajan, Lead Software Engineer at Enova International, commented saying he appreciates 2ndQuadrant’s hard work in “promoting and fostering a savvy, healthy and helpful community to welcome newcomers just like [it] did for [him] 5 years ago!”

For the second year in a row, PostgreSQL has been named DBMS of the Year by DB-Engines. This shows that developers and users alike are acknowledging the robust and versatile capabilities that it has to offer.

 

What is the number one benefit you see within Postgres that everyone should be aware of?

PostgreSQL's advanced features cater to a broad range of use cases all within the same DBMS. Rather than going for edge case solutions, developers are relying on the absolute reliability of the hyperconverged database to simplify their production deployments.

 

What is the best thing about working with the Postgres community?

The Postgres community is one of the easiest global communities to work with. There is an open mindset all around and a common goal of growing the Postgres ecosystem as a whole. 

 

Tell us why you believe people should attend PostgresConf 2019 in March.

Conferences are a great way for people in the PostgreSQL community to come together and share knowledge and ideas, which is the true spirit of open source. It is very exciting to see into the future developments of the project from the people who contribute so much to its growth.

It is a great way for members of the community to come together in person to share knowledge in different areas of the technology, describe practical use cases, and give sneak previews into cutting edge technologies for future versions of PostgreSQL.

 

About 2ndQuadrant:

2ndQuadrant provides PostgreSQL Solutions for the Enterprise - reliably deploying them on the platform of your choice and providing 24/7 Production Support. Our solutions address all aspects of your database ecosystem, ensuring high availability, disaster recovery, backup & failover management, and much more. 

Moreover, we provide tools to make your deployment process simple and reliable. With over 100 years of combined code contributions to the PostgreSQL project, our engineers ensure that your PostgreSQL solutions are fully supported in your production environment.

Visit the 2ndQuadrant team in the Exhibit Hall in the Metropolitan Ballroom on Wednesday, March 20, and Thursday, March 21.  

Check out the full schedule for PostgresConf US 2019, and buy your tickets soon!

On occasion, professional developers will drop into the Postgresql.org mailing lists, meetups, and conferences to ask the question, “Why isn’t PostgreSQL development on Github?” In an effort to see if the demand was really there and not just anecdotal we ran a poll/survey over several social media platforms that asked a simple question:

 

Should PostgreSQL development move to Github?

    • Yes
    • No
    • No, but to something like Gitlab would be good

 

We received well over 300 responses and the majority (75%+) chose a move to Github or to something like Github. This was an unscientific poll but it does point out a few interesting topics for consideration:

 

  1. We need to recognize that the current contribution model does work for existing contributors. We need to have an honest discussion about what that means for the project as contributors age, change employment, and mature in their skill set, etc..
  2. Of the people that argued in comments against the move to a service, only one is a current contributor to PostgreSQL.org core code. The rest were former code contributors or those who contribute in other ways (Advocacy, System administration, etc.).
  3. Would a move to Github or similar option produce a higher rate of contribution?

 

This poll does not answer point #3; it only provides a data point that people may desire a modern collaboration platform. The key takeaway from the conversation about migrating to Github or similar service is the future generation of developers use technology such as Slack and Microsoft Teams. They expect a bug/issue tracker. They demand simplicity in collaboration and most importantly they will run a cost->benefit analysis to determine if the effort to contribute is a net positive.

 

It should also be considered that this is not just individual potential contributors. There are many corporations big and small that rely on the success of PostgreSQL. Those corporations will not contribute as much directly to PostgreSQL if the cost to benefit analysis is a net negative. They will instead contribute through other more productive means that produce a net positive when the cost->benefit analysis is run. A good example of this analysis is the proliferation of external projects such as pg_auto_failover, patroni and lack of direct contribution from innovative extension based companies.

Do we need a culture shift within PostgreSQL?

There are those within the Postgresql.org community that would suggest that we do not need a culture shift within PostgreSQL but that does not take into account the very clear market dynamics that are driving the growth of PostgreSQL, Postgres, and the global ecosystem. It is true that 20 years of hard work by Postgresql.org started the growth and it is also true that the majority of growth in the ecosystem and community is from products such as Greenplum, Aurora, Azure, and Timescale. The growth in the ecosystem is from the professional community and that ecosystem will always perform a cost to benefit analysis before contributing.

 

It is not that we should create radical rifts or disrupt our culture. It is to say that we must evolve and shift our community thinking. We need to be able to consider the big picture. A discussion should never start as an opposition to change. The idea of change should be an open discussion about possibility and vision. It should always include whether the change is a good idea and it should always avoid visceral reactions of, "works for me,” “no,” or “we tried that 15 years ago." Those reactions are immature and lacking in the very thing the community needs to continue to grow: positivity, inclusion, vision, and inspiration.

Joshua D. Drake     May 13, 2019



The following table contains a summary profit and loss statement for PostgresConf US 2018.



In review of these numbers two things will probably jump out at you:
  1. Venue and F&B of 238,000.12
  2. Net Revenue of 202,201.62
Yes, we spent almost 250,000.00 dollars on the venue and food and beverage. In fact, the Food and Beverage alone was over 135,000.00 dollars. 

We were fortunate to have very strong ticket sales as well as partner support through Sponsorships. This support will allow us to not only meet our financial requirements for PostgresConf Silicon Valley 2018 but will help us make our financial requirements for our European, Chinese, and US conferences in 2019. We are also hoping to set aside more money for our popular diversity and professional development initiatives.

The Chairs would like to thank all our organizers, volunteers, partners and attendees for helping us continue advocacy of People, Postgres, Data!


Joshua D. Drake     May 25, 2018

 
 

As part of the countdown to PostgresConf US 2018, learn more about the engaging content and our Diamond and Platinum sponsors for this year in our Sponsor Spotlight Series.

Jacque Istok, is the Head of Data for Pivotal, one of our Diamond Sponsors for PostgresConf US 2018. Pivotal is hosting the first annual Greenplum Summit at PostgresConf US 2018, with lots of great Greenplum and Postgres-related content. Read what Jacque has to say bout Greenplum and Postgres, as well as why to attend the Greenplum Summit: 

Greenplum is an Open Source variant of Postgres; what benefits do you bring to the table over vanilla Postgres?

Postgres is a powerful ORDBMS, but as your data scales, the only way to keep up is to buy bigger and bigger machines to run on. It suffers from the same problems that all SMP databases do: you can only get as big as the machine you’re running on.

With Greenplum you can put a subset of your data on a Postgres database on one reasonably-sized machine, and another subset on a second machine, and so on. All of your users and applications can then query one of these Postgres databases as if all the data was in a single location - making your data scale limitless. Greenplum manages the distribution, data shuffling, and querying of all of your data across a magically sharded implementation of Postgres databases.

Greenplum has its own community; what do you hope to achieve by joining the Postgres community and PostgresConf?

The Postgres community represents some of the most passionate and knowledgeable creators, developers, and users of database technology of our time. We believe that the combination of Postgres and Greenplum becomes the software equivalent of what Oracle Exadata purported to be: an all-purpose database that can do both transactional and analytical workloads across multi-structured data. Simply put, the Greenplum community is looking to join with the Postgres community to further the understanding and adoption of these technologies.

Do you have plans for cross pollination of technologies with the two open source projects?

Greenplum forked from Postgres over 10 years, circa Postgres 8.2. Greenplum 5.0 is based off of Postgres 8.3, with our next major release slated for Postgres 9.4 (current open source Greenplum is compatible with 9.0 as of this writing).

Likewise, we have Postgres committers working at Pivotal looking for opportunities to improve the Postgres code specifically for analytics. We are also ensuring that other projects related to Greenplum, like Apache MADLib, continue to be compatible with Postgres.

What challenges do you see working with the Postgres community as an open source fork?

The Postgres community is a long-running and very passionate group, and we want to be both collaborative and respectful in how we continue to grow our participation. We see the products as having synergies which complement each other very well, with some use cases that best fit Postgres, and others that best fit Greenplum. The use of either benefits the other as they both further adoption.

What would you tell a user who has a choice between Postgres and Greenplum about when they should use which system?

Postgres is a great ORDBMS that will scale to the performance of a single server. For analytical needs, being restricted to a small number of terabytes does not allow for the type of exploration that most organizations need. Because Greenplum is a Postgres compatible database, you can start out using Postgres and either convert to Greenplum underneath or leverage Greenplum alongside your Postgres systems (making data ETL a ton easier). This then makes the choice of which product to use for your particular use case clearer and clearer.

What is the number one barrier you see to contributing to the Postgres community?

The number one barrier we will have to contributing is not seeing the corresponding adoption of our technologies. We feel very strongly that both the transparency and removal of vendor lock-in make our open source commitment the only choice for users. I’m here to implore the community to embrace our technology with zeal and help us continue to drive more and more Postgres adoption in the world.

What is the best thing about working with the Postgres community?

Because Greenplum is based on Postgres, we get to interact with this vast community of talent. We are also able to more seamlessly interact with ecosystem products that already work with Postgres, making the adoption of Greenplum that much easier.

Tell us why you believe people should attend PostgresConf 2018 in April.

PostgresConf is going to be awesome - with both Pivotal and Amazon headlining as Diamond sponsors - as well as the quality of speakers and their content. I wouldn’t miss it for anything.

We’re thrilled to organize the first annual Greenplum Summit at PostgresConf. Greenplum co-founder, Scott Yara, will give a keynote on April 18th relating to how data tells the story at the organizations that we help enable (#DataTellsTheStory), and his journey from SMP to MPP. Greenplum Summit on April 19th will be a full day packed with with great use case sessions and tech talks for novices and experts alike.

Check out the full schedule for PostgresConf US 2018, and buy your tickets soon!



Joshua D. Drake     March 26, 2018     pivotal Greenplum postgres postgresql

 

It is late August, 2019. This is the time where we are usually prepping for the very busy fall season and not much else. However, this is the Year of Postgres and everyone is driving 200MPH down the ecosystem highway (321.8688/KPH). We are going to kick off this newsletter with some exciting information about the community.

Events

PostgresConf has launched Digital Events! The goal of Digital Events is to open our education platform year round to all members of the community. Our first series of events will be held with our ecosystem partner YugabyteDB and their “Distributed SQL Webinar Series.” This is a series of free-to-attend Webinars exploring Distributed SQL from leaders in the field.

 

PostgreConf Silicon Valley tickets are going at a brisk pace and half day trainings are almost sold out. Register today to reserve your seat before prices go up on September 1st!

 

Right after Silicon Valley, PostgresConf South Africa is kicking off. This conference has grown by leaps and bounds over the last two years. We highly recommend attending for anyone who can!

 

PGConf.IN (India) has announced that their conference will be held in February 2020!

Meetups

We have seen the launch of three new meetups this month:

  • Los Angeles Postgres The first meetup is planned for late October or early November as we continue to build the Silicon Beach community.
  • Toronto Postgres Similar to Los Angeles, the first meetup is planned for late October or early November.
  • Charm City Postgres This meetup was formed by long time community member Robert Treat.

 

Several other meetups are growing quickly: 

 

Interested in speaking or hosting a meetup? Contact us and we’ll connect you with the right people! 

Learn

Here is a short, great introduction tutorial on running PostgreSQL in Docker by Igal Sapir, Los Angeles Postgres organizer. Everybody has 13 minutes.

 

Shawn Wang from our friends at High Go has provided an insightful write-up on AES Performance.

Ecosystem

TimescaleDB is running a “State of Postgres” survey. Please take five minutes and help them out! They have also announced a new Distributed Timeseries product.

 

VMWare has just acquired Greenplum and PostgreSQL supporting company Pivotal.

Postgresql.org

PostgreSQL versions 11.5, 10.10, 9.6.15, 9.5.19, 9.4.24, and 12 Beta 3 are now out in the wild and addressing several important security concerns and bug fixes.

 

---

 

Have news you’d like included in future newsletters? Contact us.

Joshua D. Drake     August 23, 2019

Brass tacks

  • Silicon Valley is selling tickets briskly, get yours today and join us at the largest gathering of Postgres leaders on the West Coast.

  • South Africa is set to release their schedule shortly. Watch the site for opportunities in October.

  • We have hinted at digital events in the past and they are in the final planning stages. Digital events will encompass best in class content from our community in the format of Webinars, Q&A sessions and Professional electronic training opportunities. Watch for more news on these unique opportunities as we get closer to Fall 2019.

Seasons

It is the middle of summer, and as Glenn Frey would say, “The Heat is on!” Summer is the time when everyone is busy, yet nobody is busy. You have a contract to execute but the signer is on vacation. You have a project to complete but your digital nomad developer took off for the beach. Suddenly even checks may be delayed because of a long weekend up in the mountains. It is also a time to catch up on the things that may have been overlooked. When the person driving your priorities is on vacation it is easier to step back and observe your purpose.

 

Introduction

At PostgresConf 2019 in Manhattan we organized a Diversity and Inclusion panel with the help of Plato. The panel was well attended, but not as much as we had hoped. This fact outlined that we had more work to do on expanding our leadership position within Diversity, Equity and Inclusion in the Professional Postgres community.

We take this topic very seriously and we would consider PostgresConf and our focus on People, Postgres, Data a success if the only outcome was for all to feel welcome and supported within our community. Thankfully we have organizers and volunteers who are passionate about this very topic.

We would like to introduce the PostgresConf and PgCentral Foundation DEI (Diversity, Equity and Inclusion) Work Group:

  • Debra Cerda: DEI Organizer

  • Henrietta Dombrovskaya: Contributor

  • Ryan Lambert: Contributor

  • Mara Lemagie: Contributor

  • Vikki McCormick: Contributor

  • Amanda Nystrom: Co-Chair Sponsor

Over the coming months we will be continuing to communicate our passion, our purpose, our action and our accomplishments in bringing true Diversity, Equity and Inclusion to our community.

“A genuine leader is not a searcher for consensus but a molder of consensus” -- Martin Luther King

 

PostgresConf Philly which is organized in conjunction with Philly Postgres sold out in July! A packed room, great content and glorious collaboration was available to all for free due to the generous support of the Wharton School for Business!

As we continue to build our professional relationships, connections with academia are going to be vital. Academia is one of the few spaces that Postgres has not been able to make assertive gains in adoption and it crucial to the long term vision of our community that Academia recognize and adopt Postgres as the World’s Database and a viable option for teaching the next generation of data experts.

 

International communication

As our community grows Internationally with strong ties to Asia, and countries in the Southern Hemisphere it becomes difficult to connect with those cultures using our normal nomenclature. In our last newsletter we used a quote meant to be a compliment and challenge to the Western communities to try new things. The quote was about pigs ears and how they are delicious. The quote was interpreted by some in the Asia community as negative.

While writing this newsletter, we had used a spelling variation for the term “Wowzers” which in American pop culture is meant to be an exclamation of amazement. However in other cultures it maintains a negative connotation causing us to change the term to Kapow. These communication challenges show us that we must be open and without pride in our communication. We must show patience and understanding with cultures that are not like ours and that the communities that are able to achieve this will lead the future of Open Source and Postgres.

“Every human is like all other humans, some other humans, and no other human” — Clyde Kluckhon

Joshua D. Drake     July 31, 2019