Joshua D. Drake Blog Posts

Postgres Tech Bulletin: August 7th, 2019

Congratulations

Henrietta Dombrovskaya, Diversity, Equity, and Inclusion member for PostgresConf as well as Chicago Postgresql organizer nominated for Technologist of the Year!

 

Career Opportunity

A large, well known media company is seeking a Senior Level PostgreSQL Engineer and Architect. This is an on-site engagement, however the company is known to be lifestyle friendly with reasonable working hours, good pay, and benefits. Specific talents requested are the ability to mentor. The location is Seattle, WA. If you are interested in this position please contact randy@neuringerco.com with your resume.

Great content

Extension Highlight

We wanted to highlight some of the fantastic work that is being done by the ecosystem with Postgres Extensions. Although the base of Postgres is the amazing and extensible PostgreSQL, a lot of users don’t realize that Postgres has the feature they are looking for, if only they were to look to the ecosystem.

Notable Extensions:

  • pgaudit : The goal of pgAudit is to provide PostgreSQL users with the capability to produce audit logs often required to comply with government, financial, or ISO certifications.

  • pg_credereum : pg_credereum is a PostgreSQL extension that provides a cryptographically verifiable audit capability for a PostgreSQL database, bringing some properties of blockchain to relational DBMS.

  • H3-pg : PostgreSQL bindings for H3, a hierarchical hexagonal geospatial indexing system.

Postgres can do what?

There are a ton of Postgres compatible features out there. Some of them are overlooked core features and some of them require installing a different version of Postgres. Here are a few examples:

 

  • TimescaleDB: Time series data management with Postgres

  • YugabyteDB: Globally Distributed database with PostgreSQL compatibility

  • Postgres-XL: Horizontally partitioned PostgreSQL

  • Agensgraph: Graph capabilities with Postgres

  • PG-Strom: GPU accelerated extension for Postgres 

 

Upcoming Education and Networking opportunities:

 

Joshua D. Drake     August 07, 2019

PGConf APAC 2018

The International Postgres conference  series continues to grow! PGConf APAC 2018 is the latest PGConf.Org addition.

Following the success of two consecutive pan-Asia Postgres event - pgDay Asia 2016 and pgDay Asia 2017 held along with FOSSASIA, we are pleased to announce PGConf APAC 2018 to be held in Singapore from 22nd to 24th of March, 2018. Once again the conference will be held along with FOSSASIA - one of the largest FOSS conference on the planet. PGConf APAC will be PostgreSQL conference series for all PostgreSQL enthusiasts and users in the Asia Pacific region.
For more details on FOSSASIA - http://2018.fossasia.org
You will be able to enjoy one of the largest PostgreSQL conference in Asia and one of the largest FOSS conferences to meet like minded individuals in the same week!
pgDay Asia 2016 and pgDay Asia 2017 would not have been possible without your awesome talks and we would like to invite speakers from all over the globe to present at the PGConf APAC 2018. We would like to open Call For Paper for PGConf APAC 2018. Some of the topics which can be used for submitting a talk are-
  1. Migration projects
  2. Performance troubleshooting and tuning
  3. noSQL and geo-spatial features of Postgres
  4. Unique use-case and customer stories
  5. Useful new features in PostgreSQL 10
For more examples you can refer to the papers which were presented at last year's event - 2016 and 2017.
Of course we are happy to accept paper proposals on any other interesting topics as well.
To submit you proposal for presentation please go to this link - http://2018.pgconfapac.org/cfp
Venue
To be Announced
Call for Papers
2017-10-10: Proposals acceptance begins
2017-12-04: Proposals acceptance ends
2017-12-13: Authors of accepted proposals contacted
If you need any additional information please contact our team at pgconfapac(at)googlegroups(dot)com.
This conference is organized by the PostgreSQL people from Asian communities. If you have any question, feel free to contact us on pgconfapac(at)googlegroups(dot)com.
For sponsorship related queries please get in touch with our team at apac-organizer(at)pgconf(dot)org.
Joshua D. Drake     October 10, 2017

PostgresConf 2019: CFP and Early Bird closing soon

PostgresConf hopes everyone had a great holiday season and we hope everyone has a fantastic 2019.

With January upon us, we start conference season. This year, PostgresConf 2019 will be in NYC at the Sheraton New York Times Square March 18-22, 2019.

If you have a story about lessons learned with Postgres, a cool feature that you've found a creative way of using, or just some practical knowledge you'd like to share with your fellow Postgres users, submit a talk. Remember, there are many people who are new to Postgres, so introduction levels talks are welcome. The CFP ends this Friday so get your talks submitted soon at:
https://postgresconf.org/conferences/2019#callforpapers

Also, the Early Bird window for PostgresConf 2019 will be ending next Friday, January 18. This tickets are pretty substantially discounted if you purchase them early. On top of the Early Bird discount, for being a member of the NYC Postgres User Group, there is a promo code for an additional 15% off. Just use the code 2019_PUG_NYC when buying your tickets.
Lastly, if you are already in the NYC area we look forward to seeing the community at the Winter Party on the 10th!
We hope to see you at PostgresConf 2019 and remember:



Joshua D. Drake     January 09, 2019

People and Postgres: April 17th, 2019

People and Postgres: April 17th, 2019

Welcome to the first of what we hope will be a thriving and productive way to interact with the People, Postgres, Data community!

The goal of this newsletter is to let our community know the ins-and-outs of what is happening in the world of Postgres and the Postgres ecosystem. Let's start from the top: 

  • Ecosystem news

    • JD, Co-Chair of PostgresConf, was recently part of the Inside Analysis podcast: The Evolving Enterprise. This podcast is not only available on the Internet but was live on 20 radio markets. 
    • Crunchy Data Collaborates With Center for Internet Security® To Continue Advancing PostgreSQL Security For Enterprise
    • The Distributed SQL Summit is being held at PostgresConf Silicon Valley on September 20th, 2019.
      • This unique "event within an event" strategy was spearheaded by PostgresConf with the Regulated Industry summit years ago and it continues to grow with events such as the AWS Migration Day and the Pivotal Greenplum Summit. The Distributed SQL Summit is a vendor neutral single day event specializing in providing high quality Developer, Architect and other Practitioner content on deploying and developing production quality products and services over Distributed SQL. It is sponsored by:
Joshua D. Drake     April 17, 2019

PostgreSQL High Availability and Geographic Locality using consul by Sean Chittenden




The presentation includes an introduction and setup for consul as the means of providing highly available PostgreSQL in local and geographically disparate data centers or cloud providers. The presentations includes:

*) Introduction to consul and its architecture
*) Setup of a single consul cluster
*) Setup for a few sample database instances (OLAP and OLTP)
*) Firewall requirements
*) Integration with bind, djbdns, and dnsmasq
*) Setup geographic failover to two different data centers and cloud providers
*) Various Best Practices tips and suggestions
*) Q&A

Joshua D. Drake     April 25, 2017

Community Profile: Alex Tatiyants and Pev

We caught up with Alex Tatiyants after finding out about his Pev project. This is an awesome web based visual explain analyzer that is similar to the awesome explain.depesz . 

Tell us a little bit (one or two paragraphs) about your project or how you use Postgres: 

I created Pev (Postgres EXPLAIN Visualizer) to scratch my own itch. EXPLAIN generates a wealth of information, but isn’t easy to make sense of. I wanted to create a tool that helps me quickly diagnose problems with queries. Apparently, other people found it useful as well.


Pev plan


Why did you chose Postgres for your project? 


Postgres is a fantastic database: performant, mature, feature rich, and of course open source. And in addition to being a first rate relational database, it has very strong document store features as well.


Have you attended a PgConf US event or do you plan to? 

I haven't had a chance to attend PgConf.

Are you interested in contributing to the community further and if so, in what fashion? 

I don’t have any concrete plans at the moment.

Any closing comments? 

Thank you for your interest.
Joshua D. Drake     August 16, 2017

3 presentations, 1 PGConf: NYC Mini!

We are having yet another PGConf Mini in NYC. The event is scheduled for December 14th, 2017 and Work Bench is hosting:

 
 
The event is part of the PGConf Mini series and is free to attend. The PGConf Mini series works directly with user groups and external communities to organize events for the local community. The events are held as a larger meetup style event with networking opportunities and up to 4 presentations. The current agenda for the latest PGConf Mini: NYC is:
 
Agenda: 
 
• 6:30 - 7:00: Jonathan Katz, (TBD), Postgresql Contributor and PGConf Chair Emeritus

Efficiently and Safely Propagate Data Changes Without Triggers!

 

Prior to PostgreSQL 9.4, the primary way to distribute data-driven changes across multiple tables was to use triggers. While triggers guarantee that these changes will be propagated, they can have a significant impact application performance, both technically and with development time (see: "debugging"). PostgreSQL 9.4 introduced logical decoding, which provides a way to stream all changes in a database to a consumer. Using a logical decoder, you can read all changes that are made in a table into your programming language of choice to perform many tasks: cache invalidation, data propagation, submitting changes to remote services, and more. Many PostgreSQL drivers, such as psycopg2 and JDBC support the logical replication protocol, which lets you easily stream your database changes to be manipulated using your favorite programming language. This talk will demonstrate how you can setup logical decoding for your application, look at architecture strategies for working with a logical decoder, and look at a case-study that shows how using logical decoding led to a big performance boost over a similar trigger-based system.
 
• 7:00 - 7:30:  Kevin Jernigan, Senior Product Manager, Amazon
Technical Architecture of Postgres Aurora 
 
Amazon Aurora is a cloud-optimized relational database that combines the speed and availability of high-end commercial databases with the simplicity and cost-effectiveness of open source databases. The recently announced PostgreSQL-compatibility, together with the original MySQL compatibility, are perfect for new application development and for migrations from overpriced, restrictive commercial databases. In this session, we’ll do a deep dive into the new architectural model and distributed systems techniques behind Amazon Aurora, discuss best practices and configurations, look at migration options and share customer experience from the field. 
 
• 7:30 - 8:20: Joshua (JD) Drake POSTPONED due to flight cancellation)
The Power of Postgres Replication, Postgres Expert - Lead Consultant Command Prompt, Inc and Co-Chair PGConf!
 
With PostgreSQL v10 a new replication engine has come to town. Let's explore Postgres Logical Replication, how to use it, optimize it and let it best fit in with your organization. We will also discuss its interactions with external tools as well as Binary Replication and features such as Hot Standby. 
 
 
 
 
Joshua D. Drake     November 20, 2017

Community Days: BigApplePy and DockerNYC

In 2016 we started working with horizontal communities. We wanted to make sure that PgConf US was an inclusive community that advocated not only for the best database in the world but also all the external Open Source technologies that make the best database in the world the best platform in the world. 

This year we wanted to continue building a stronger community through relationships and our efforts are proving successful. We have joined forces with several horizontal communities to bring original and related content to PgConf US. The first is Big Apple Py. They are working with PgConf US to run a full track of Python content as well as a development workshop. 


The workshop is particularly interesting as it will focus on a code sprint to develop a mature and user friendly Python based conference software. I wonder if they know we already use a Ruby on Rails solution...

We also have a great workshop being presented by DockerNYC and Jesse White: Automating production ready databases in Docker
DockerNYC
PgConf US 2017 is less than two weeks away and we continue to work with communities to bring you even more new content! Stay tuned as we expect to announce more workshops in the next few days. If you haven't purchased your tickets, today would be a good day.
Joshua D. Drake     March 15, 2017

Top 10 Mistakes When Migrating From Oracle to PostgreSQL

PGConf US and Austin PUG organized a PGConf Mini last night. It was three presentations over the evening. We had good attendance and excellent community participation. The highlight of the evening was PGConf US Co-Chair Jim Molgendski's presentation, "Top 10 Mistakes When Migrating from Oracle to PostgreSQL".

We tried something new this time around. We utilized Twitter's Periscope capability to live stream his presentation. It wasn't perfect but it was our first time and we are looking forward to utilizing the platform more in the future.

Click here to watch "To Mistakes When Migrating From Oracle to PostgreSQL", and then submit a presentation to one of our upcoming conferences:


PGConf US 2017 - 2018 
  • Diamond Sponsor: Amazon Web Services
  • Platinum Sponsor: OpenSCG

Joshua D. Drake     May 17, 2017

Announcing PGConf Austin 2017 -- Call for Papers now Open

PGConf US in partnership with the Austin PostgreSQL User Group (AUSPUG) is pleased to announce that the call for papers for PGConf Local: Austin is now open.


AUSTIN, June 28, 2017 -- The inaugural PGConf US Local: Austin Conference (PGConf Austin) will be held November 3 - 4, 2017, at the Norris Conference and Event Center (2525 W. Anderson Ln #365, Austin, TX 78757) located in northwest Austin.


This two day, multi track conference is a perfect opportunity for users, developers, business analysts and enthusiasts from the Southwest to amplify Postgres and participate with the Postgres community.
The Call for Papers for PGConf Austin is now open, and presentation proposals can be submitted at https://pgconf.us/conferences/Austin2017

The call for papers for PGConf Austin will be open until Sunday, August 20, 2017, and speakers will be notified of acceptance/decline no later than Monday, August 28, 2017. Registration for PGConf Austin will also open August 28.

Conference Schedule:
  • Friday, November 3, 2017: Half-day Trainings with Postgres experts
  • Saturday, November 4, 2017: Breakout Sessions (lunch and coffee break provided)


Conference speakers receive complimentary entry to the breakout sessions on November 4 -- the half-day trainings are separately priced sessions. As a nonprofit event series, funding is currently not available for speaker travel and lodging accommodations. Everyone is encouraged to submit a talk or training to the first PGConf supported nonprofit educational events in Texas, and join the growing PostgreSQL community.
Sponsorship Opportunities
PGConf Local series is supported by its generous sponsors, including Diamond Sponsor Amazon Web Services and Platinum Sponsors 2ndQuadrant, Compose, and OpenSCG, as well as Media Sponsor AmplifyPostgres. Business leaders and companies interested in sponsoring PGConf US nonprofit events can view the Conference Prospectus .


About PGConf US:
PGConf US is a nonprofit conference series with a focus on growing the Postgres community through increased awareness and education of Postgres. PGConf US is known for its highly attended national conference held in Jersey City, New Jersey, each year, and has expanded to a local series for 2017.


The PGConf Local series partners with local Postgres and open source groups to bring dynamic and engaging Postgres related content and professional training experience to their local communities in major metroplexes. 2017 host cities include Philadelphia, Seattle, and Austin, as well as Internationally in South Africa with more locations to follow.


Media Contact: organizers@pgconf.us

Joshua D. Drake     June 28, 2017