Navigating Silent Failures in AI: Strategies for Effective Oversight | Real Python Podcast #308

python
youtube
Navigating Silent Failures in AI: Strategies for Effective Oversight | Real Python Podcast #308 Why do AI systems silently fail? How can you set up a system that produces results while also reviewing and validating the work? This week on the show, Calvin Hendryx-Parker returns to discuss his recent talk "Orchestrate Agentic AI: Context, Checklists, and No-Miss Reviews." 👉 Links from the show: Calvin describes how silent failures can occur when handing a large document to an LLM for parsing. He describes it as the tragedy of context, where the LLM is confident, but you have no idea what it didn't read. We discuss issues with file formats, dropped attachments, and silent truncation. Calvin shares the example project from his talk, which includes Markdown files for the agents, hooks, skills, and scripts. He also discusses a variety of coding agents, skill frameworks, and CLI tools. Topics: - 00:00:00 -- Introduction - 00:02:19 -- Co-hosting Python Bytes - 00:03:43 -- Why AI Fails Silently talk - 00:11:07 -- Digging into silent failures and an audit trail - 00:18:44 -- How would you define hooks? - 00:20:48 -- Document extraction, embeddings, and Cowork - 00:30:38 -- Stripping the noise from file formats - 00:34:43 -- Things that are now baked into models - 00:45:53 -- Video Course Spotlight - 00:47:23 -- Leveraging agents to pick models - 00:51:44 -- GitHub repo for the project - 00:54:57 -- The current market around tokens - 01:00:12 -- What are you excited about in the world of Python? - 01:03:02 -- What do you want to learn next? - 01:04:21 -- The content the LLMs
  2026/08/21      youtube

関連するプログラミング動画 [python]

Our Tag

最近投稿されたプログラミング学習動画

The Registry Pattern: Cleaner Python Than if-elif

python

Download your free Python Cheat Sheet he...

  2026/08/21

Navigating Silent Failures in AI: Strategies for Effective Oversight |

python

Why do AI systems silently fail? How can...

  2026/08/21

Block Ads and Take Control of Your Network!

python

Download your free Python Cheat Sheet he...

  2026/08/20

Working With Python's deque: Getting Started & Popping/Appending Items

python

Download your free Python Cheat Sheet he...

  2026/08/20

Programming in the AI Era: Real Python Office Hours

python

Join us for a live Office Hours where we...

  2026/08/20

Working at Google: Embedded Software Engineering Manager

Google

Step into the world of Google Platforms ...

  2026/08/19

Every Failed Attempt to Kill the Python GIL

python

Download your free Python Cheat Sheet he...

  2026/08/19

Getting Started: AWS Certified Machine Learning Engineer - Associate |

Amazon
study

Subscribe to AWS: Create a free AWS ac...

  2026/08/19

Getting Started: AWS Certified AI Business Strategist | Amazon Web Ser

Amazon

Subscribe to AWS: Create a free AWS ac...

  2026/08/19

Using generative AI to transform production with Volkswagen Group and

Amazon

Stefan Krawinkel shares how Volkswagen G...

  2026/08/19

Amazon GuardDuty AI investigations | Amazon Web Services

Amazon

AWS now offers AI-powered investigations...

  2026/08/18

10 Hidden Browser Features Your AI Doesn’t Know About

The browser is constantly releasing new ...

  2026/08/18

Build a live translation broadcast app with the Gemini Live API and Li

Learn how to build a real-time multiling...

  2026/08/18

Help fix our AI-powered pet supply store

Amazon

Subscribe to AWS: Create a free AWS ac...

  2026/08/18

How do I use AWS DMS to create source or target endpoints?

Amazon

0:00 Introduction 0:34 Create a replicat...

  2026/08/18

Build a live translation broadcast app with the Gemini Live API and Li

Learn how to build a real-time multiling...

  2026/08/17