Case Study: Secure and high performant data lake
Pratik Verma is the founder and chief product officer at BlueTalon. Pratik founded BlueTalon to accelerate big data deployments and remove security as a barrier to adoption. Previously, he led AgeTak, a healthcare startup build on technologies created by Rakesh Verma. He is an angel investor in several tech startups. Pratik’s scientific work has been published in peer-reviewed journals. He holds a PhD from Stanford.
No video of the event yet, sorry!
"Coming together is a beginning. Keeping together is progress. Working together is success." --Henry Ford
A data lake is where data generated by different applications, commercial and homegrown) of multiple business units is stored in one place. It’s operated upon by multiple compute platforms like Postgres/Greenplum and Hadoop. Given that all the business data comingle, the access control is critical for data lakes to ensure that users have access to the right data that they are entitled to access. Typically people try to address this with a ton of custom views that attempts to handle the security logic. This is often a maintenance and performance nightmare.
In this presentation, we’ll present a real-life data lake use case of one of the largest company having a number of business divisions. We’ll present the security challenges faced and how the solution provided by BlueTalon address those with templated role-based policies and dynamic query modification. We’ll further discuss the query performance challenges and how the dynamic query rewrite can be leveraged to optimize queries and reroute based on the most recent version of data.
- 2019 March 20 15:10
- 50 min
- Postgres Conference
- Regulated Industry