Free Daily Podcast Summary
Data Engineering Central Podcast: Daily Summaries Delivered
by Data Engineering in Real Life
Long Live the Data Engineer. No holds barred. Talking about Data Engineering news, topics, and general mayhem. dataengineeringcentral.substack.com
Latest Episodes
The most recent episodes — sign up to get AI-powered summaries of each one.
- 3 days ago50 min
Life After Big Tech
What happens when you finally achieve financial independence, walk away from a successful career in Big Tech, and have the freedom to do whatever you want? Is it everything you imagined it would be?In this episode of the Data Engineering Central Podcast, I’m joined once again by Kevin Martin, who spent nearly 13 years working at Apple before deciding he’d had enough of the corporate grind. When we last spoke, Kevin had just left Apple and was preparing to spend much of 2026 backpacking some of America’s most beautiful wilderness.Thanks for reading Data Engineering Central! This post is public so feel free to share it.Well, Kevin is back, and he’s got some stories to tell.Since our last conversation, Kevin has completed hundreds of miles of backpacking, including the Benton MacKaye Trail and the legendary John Muir Trail. Along the way, he spent a terrifying night with multiple black bears circling his tent in the Smoky Mountains, experienced the incredible beauty of the Sierra Nevada, and learned some unexpected lessons about himself.One of the most interesting things Kevin discovered was that leaving the corporate world doesn’t necessarily mean leaving behind the mindset that made you successful there. After years of working in a high-performance environment at Apple, he found himself approaching retirement and backpacking with the same intensity, planning, and expectations that he’d brought to his career.* We dig into that realization and what it means to actually enjoy the financial freedom you’ve worked so hard to achieve.Of course, we also wander into plenty of other topics, including the changing landscape of Big Tech, AI-driven layoffs, whether anyone’s job is really safe anymore, and the importance of building financial independence in an increasingly uncertain world.* We talk about lifestyle inflation, the FIRE movement, the psychology of money, and why doing difficult things in the outdoors can completely change your perspective on everyday problems.Perhaps my favorite part of the conversation is our discussion about happiness and the tendency to constantly chase the next big milestone. Whether it’s a promotion, a financial goal, retirement, or climbing a mountain, there’s always something else waiting on the horizon.At what point do we stop chasing the next thing and actually enjoy the life we’ve built?It’s a fun, thoughtful conversation that goes well beyond technology and money. If you work in tech, dream about financial independence, love the outdoors, or simply find yourself wondering what life might look like outside the traditional career path, I think you’ll enjoy this one.Grab a cup of coffee and join us!Thanks for reading Data Engineering Central! This post is public so feel free to share it. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit dataengineeringcentral.substack.com/subscribe
- Sep 30, 202649 min
AI Is a Mirror: MLOps, LLMOps & the Future of AI Engineering | Maria Vechtomova
What does it actually take to build AI systems that work in production?In this episode of Data Engineering Central, I sit down with Maria Vechtomova, AI Engineering Lead, co-founder of CAUCHY, Databricks MVP, and author of MLOps with Databricks.Maria has spent more than 12 years working across data, machine learning, MLOps, and AI engineering. We talk about how production ML has evolved from the early days of homegrown model platforms to today’s world of LLMs, agents, Databricks, MLflow, and AI-assisted coding.We dig into why LLM applications can be significantly harder to evaluate and monitor than traditional ML, the growing importance of tracing and observability, and why governance becomes more complicated when agents can interact with data and other systems. Maria also explains why many of the problems we’re facing with AI aren’t actually new — AI has simply made them much harder to ignore.* We also get into AI coding tools, testing AI-generated code, Databricks and Unity Catalog, the rapidly changing LLMOps ecosystem, and what engineers should focus on as AI changes the way software is built.One of my favorite ideas from the conversation: AI is a mirror. It can help you write a lot more code, a lot faster — but whether that code is actually good still depends on the engineer behind it.Maria also shares what she thinks matters most for engineers entering the field today: common sense, soft skills, and business sense.Topics include: MLOps and LLMOps, production AI, Databricks and MLflow, AI agents, observability and tracing, model and LLM evaluation, AI governance, Unity Catalog, AI-generated code, testing, and the future of AI engineering.Thanks for reading Data Engineering Central! This post is public so feel free to share it. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit dataengineeringcentral.substack.com/subscribe
- Sep 16, 202646 min
The Future of Data Engineering in the Age of AI | Erfan Hesami
I sat down with Erfan Hesami, founder of Pipeline to Insights, to talk about where data engineering is headed as AI and agents become part of everyday engineering work.We dig into the changing role of the data engineer, the growing overlap between data and AI engineering, and why strong fundamentals may actually become more important as AI makes writing code cheaper and easier.We also talk about AI agents inside modern data platforms, governance and security, AI-generated code and technical debt, controlling AI costs, the importance of human judgment, and why communication and business skills are becoming increasingly valuable for engineers.* Erfan also shares the story behind Pipeline to Insights, how writing helped accelerate his own learning, and how consistency helped him grow the publication from its first post in October 2024 into a successful data and AI community.If you’re a data engineer, analytics engineer, AI engineer, or someone trying to break into data, this conversation offers a grounded look at what skills are likely to matter as AI changes how we build software and data systems.Thanks for reading Data Engineering Central! This post is public so feel free to share it. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit dataengineeringcentral.substack.com/subscribe
- Sep 9, 202649 min
Big Tech Laid Him Off. He Realized He Didn’t Need a Job. — Asian Dad Energy
What happens when you spend decades building a successful career in tech, finally reach Big Tech, and then suddenly get laid off?In this episode of the Data Engineering Central Podcast, I sit down with AsianDadEnergy to talk about his journey from writing BASIC on an IBM 386 and working with COBOL mainframes to consulting, becoming a chief architect in Big Tech, and eventually losing his job after seven years.But the layoff wasn’t the end of the story.Years earlier, the 2008 financial crisis convinced him and his wife to live below their means, eliminate debt, save aggressively, and invest. By the time his Big Tech layoff arrived, those investments had grown enough to cover their living expenses—and he eventually realized he didn’t actually need to find another job.We also get into AI and the future of software engineering, why junior engineers may be particularly vulnerable, whether AI is taking away some of the struggle that traditionally made programmers better, and why communication and other human skills are becoming survival skills for engineers—not just skills you need to get promoted.Finally, we talk about separating your identity from your job, building multiple streams of income, creating content on YouTube and Substack, and why there is a lot more to life than what happens in front of a computer screen.https://www.youtube.com/@AsianDadEnergyBig Tech. AI. Layoffs. Financial independence. Content creation. And figuring out what actually matters when the career you’ve spent decades building suddenly disappears.I think this one will resonate with a lot of people working in tech right now.Thanks for reading Data Engineering Central! This post is public so feel free to share it. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit dataengineeringcentral.substack.com/subscribe
- Sep 2, 202656 min
Spark Isn't Going Anywhere. So They Rebuilt It in Rust. — Shehab Amin, CEO of LakeSail
In this episode, I sit down with Shehab Amin, co-founder and CEO of LakeSail, to talk about what happens when you decide to rebuild one of data engineering’s most important technologies, Apache Spark, in Rust … sorta.We dig into Shehab’s journey from writing C++ as a kid to studying computer science at Berkeley, becoming a founder, and eventually building Sail. We talk about why Spark has remained so sticky, what Rust, Apache Arrow, and DataFusion are changing about data infrastructure, and why rebuilding Spark compatibility turned out to be much harder—and more interesting—than expected.We also get into the increasingly complicated modern data stack: Delta Lake vs. Iceberg, catalogs, streaming vs. batch, agentic coding, and what happens when AI agents start interacting directly with data and compute.Most importantly, we explore LakeSail’s bigger idea: what if the data pipelines companies already have could become the foundation for their AI pipelines?A wide-ranging conversation about Spark, Rust, AI, and where data engineering goes from here.Thanks for reading Data Engineering Central! This post is public so feel free to share it. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit dataengineeringcentral.substack.com/subscribe
- Jul 22, 202633 min
Agentic Data Engineering Is Here — But Can It Close the Loop?
AI can now write SQL, generate Python, review pull requests, and build entire applications with a few well-crafted prompts. Yet despite all of that progress, data engineering still feels oddly resistant to the full AI revolution. Pipelines break. Data models drift. Production data needs validation. Someone still has to close the loop.In this episode of the Data Engineering Central Podcast, I sat down with Hugo Lu, founder and CEO of Orchestra, to talk about what “agentic data engineering” actually means beyond the buzzwords. Rather than another conversation about AI replacing engineers, we dug into the infrastructure that’s still missing before autonomous data platforms become reality.* Hugo shares his unlikely path into data engineering, from investment banking to helping build data systems at Juul, before eventually founding Orchestra. Thanks for reading Data Engineering Central! This post is public so feel free to share it.What started as an effort to simplify orchestration has evolved into a broader vision where AI agents don’t just generate code, but can safely execute work, observe the results, validate changes, and iteratively improve pipelines inside secure environments. * That ability to observe outcomes, what many are calling “closing the loop,” may be the missing ingredient preventing today’s coding agents from becoming truly autonomous.We also explore why data engineering has not experienced the same AI disruption as traditional software engineering. While AI can produce application code remarkably well, production data systems introduce a completely different set of problems. Branching production data, validating schema changes, testing transformations against realistic datasets, and understanding business semantics all remain difficult challenges that require much more than simply generating code.The conversation naturally turns toward the future of the profession itself. We discuss whether junior engineers are losing the traditional apprenticeship path, how senior engineers are shifting from writing code to reviewing AI-generated work, and why decades of experience debugging production systems may actually become even more valuable in an AI-first world. Rather than eliminating engineering expertise, AI may simply be changing where that expertise is applied.Data Engineering Central is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.Finally, we dive into the rapidly changing data infrastructure landscape. From DuckDB and Polars to serverless compute, Iceberg, semantic layers, AI-native orchestration, and the growing concern over rising LLM token costs, we discuss where the industry appears to be heading and which trends are likely to stick long after today’s hype cycle fades.If you’ve been wondering what comes after Orchestration, how AI agents will actually manage production data pipelines, or whether data engineering itself is about to undergo its biggest transformation in a decade, I think you’ll enjoy this conversation.In this episode we discuss* What “agentic data engineering” actually means.* Why AI still struggles to fully automate data engineering.* The importance of closing the loop with production feedback.* Why orchestration may become the operating system for AI agents.* The changing role of data engineers in an AI-first world.* Why junior engineers face a very different career path than previous generations.* DuckDB, Polars, serverless data platforms, and where modern infrastructure is heading.* Whether today’s dependence on proprietary LLMs will create tomorrow’s vendor lock-in.* How Orchestra is building infrastructure for AI-native data platforms.Thanks for reading Data Engineering Central! This post is public so feel free to share it. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit dataengineeringcentral.substack.com/subscribe
- Jul 15, 202647 min
What Happens When a Software Engineer Builds a Company Alone?
When people think about starting a software company, they usually imagine raising venture capital, hiring engineers, and growing a team as quickly as possible.Michael Drogalis chose a different path.After helping build technology in the Kafka ecosystem, founding a startup that was ultimately acquired by Confluent, and leading product for stream processing, he walked away from big tech to see if one person could build a serious B2B software company.* The result became ShadowTraffic, a product that helps engineering teams generate realistic production traffic for testing, demos, and development.Data Engineering Central is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.In this conversation, we talk about much more than streaming systems. We discuss why most engineers underestimate the importance of understanding customers, how AI is changing software development without replacing experienced engineers, what it takes to market technical products, and why writing publicly can become one of the biggest accelerators of your career.If you’ve ever considered building your own product, becoming a solopreneur, or simply becoming a better engineer, this conversation is packed with practical advice from someone who’s actually done it.I think this episode has broad appeal beyond data engineering. It’s really about engineering careers, entrepreneurship, and building products that solve real problems, which should make it one of your more accessible interviews.* Building and selling a Kafka startup* Life inside Confluent during its rapid growth* Why Michael left big tech to become a solopreneur* Building ShadowTraffic from scratch* Finding customers before writing code* Why marketing matters more than most engineers think* Using AI without becoming dependent on it* The future of software engineering* Writing online and building an audience* Advice for engineers who want to start their own businessThanks for reading Data Engineering Central! This post is public so feel free to share it. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit dataengineeringcentral.substack.com/subscribe
- Jul 8, 20261h 0m
The Creator of Pandas on AI, Apache Arrow, and the Future of Software Engineering
The creator of Pandas and co-creator of Apache Arrow, Wes McKinney, joins the Data Engineering Central Podcast for an in-depth conversation about how modern data engineering came to exist, where AI is taking software development, and why good engineering still matters more than ever.We start with Wes’ journey from building GoldenEye fan websites as a teenager to creating Pandas while working at a quantitative hedge fund, and eventually launching Apache Arrow, one of the foundational technologies behind today’s modern data ecosystem. Along the way, we discuss Cloudera, Parquet, DuckDB, DataFusion, Spark, and how the industry evolved from Hadoop to today’s lakehouse architectures. Thanks for reading Data Engineering Central! This post is public so feel free to share it.The second half of the conversation dives deep into AI. Wes explains why large language models make experienced engineers more productive but won’t magically replace software engineering, why architecture and good taste are becoming more valuable than writing individual lines of code, and why projects like DuckDB and * Apache Arrow remains incredibly difficult to recreate with AI alone. We also discuss open-source, local AI models, token costs, multimodal data platforms, and what new engineers should focus on to build long-term careers in software and data.If you’re a data engineer, software engineer, architect, engineering leader, or simply interested in where AI is taking our industry, this is a conversation you won’t want to miss.Topics We Cover* How Pandas was created* The story behind Apache Arrow* Why Arrow became the standard for modern data systems* DuckDB, DataFusion, and the next generation of data tools* The evolution from Hadoop to lakehouses* Why AI won’t replace great software engineers* Architecture vs. coding in the AI era* Building trustworthy open source software* The future of data engineering* Advice for new engineers entering the industryIf you enjoy conversations with the people building the future of data engineering, subscribe for more interviews with the creators of the tools we use every day.Data Engineering Central is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber. This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit dataengineeringcentral.substack.com/subscribe
Get Data Engineering Central Podcast summaries in your inbox
Free AI-powered daily recaps. Key takeaways, quotes, and mentions — in a 5-minute read.
Get Free Summaries →Free forever for up to 3 podcasts. No credit card required.
You Might Also Like
Listeners also like.
Latent Space: The AI Engineer Podcast
Conversations with AI engineers, researchers, and founders on foundation models, AI agents, infrastructure, and scientific discovery.
The Platform Engineering Show
PlatformEngineering.com
Data Science With Sam
Discussions with data scientists and AI practitioners about real-world tools, deployments, and challenges in data science and artificial intelligence.
The Pragmatic Engineer
Insightful deep dives with experienced engineers on real-world software development challenges and lessons.
Training Data
Discussions with AI researchers and builders exploring the technological, business, and societal impacts of artificial intelligence.
Everyday AI Podcast – An AI and ChatGPT Podcast
Covers practical uses of AI tools like ChatGPT and Midjourney to help people work more efficiently and advance their careers.
The Peterman Pod
Career stories from a former Instagram Staff engineer to help software developers grow.
This Week in AI
Four AI experts analyze the latest news and trends in artificial intelligence each week.
The AI in Business Podcast
Interviews with AI executives reveal practical applications and strategic insights for business leaders adopting AI.
The Every Podcast
Professionals discuss and demonstrate how they use AI tools in their work and lives, with live experiments and chat reviews.
"The Cognitive Revolution"
Explores the transformative impact of artificial intelligence through interviews with innovators shaping its future.
Unriveted
Discusses technology, AI, machine learning, data engineering, cloud services, and the startup experience.
About Data Engineering Central Podcast
Long Live the Data Engineer. No holds barred. Talking about Data Engineering news, topics, and general mayhem. dataengineeringcentral.substack.com
Customized Recaps
AI-powered recaps with compact key takeaways, quotes, and insights.
Straight to Your Inbox
Get key takeaways from Data Engineering Central Podcast in a 5-minute read.
Save Hours Every Week
Stay current on your favorite podcasts without falling behind.
Frequently Asked Questions
What is Podzilla's Data Engineering Central Podcast daily summary?
It's a free AI-powered email that summarizes new episodes of Data Engineering Central Podcast as soon as they're published. You get the key takeaways, notable quotes, and links & mentions — all in a quick read.
How does the Data Engineering Central Podcast podcast summary work?
When a new episode drops, our AI transcribes and analyzes it, then generates a personalized summary tailored to your interests and profession. It's delivered to your inbox every morning.
Is this an official Data Engineering Central Podcast product?
No. Podzilla is an independent service that summarizes publicly available podcast content. We're not affiliated with or endorsed by Data Engineering in Real Life.
Can I get summaries of other podcasts too?
Absolutely! The free plan covers up to 3 podcasts, any in the catalog. Basic raises that to 15, Pro to 40 and Max to 100. Browse our full catalog at /podcasts.
How often does Data Engineering Central Podcast release new episodes?
Data Engineering Central Podcast publishes weekly. Our AI generates a summary within hours of each new episode.
What topics does Data Engineering Central Podcast cover?
Data Engineering Central Podcast covers topics including News, Technology. Our AI identifies the specific themes in each episode and highlights what matters most to you.
Start getting Data Engineering Central Podcast summaries tomorrow morning.
Free forever for up to 3 podcasts. No credit card required.
Free forever for up to 3 podcasts. No credit card required.