Skip to content

Testing ML systems

Practical AI

Hosted by Chris Benson and Daniel Whitenack

47m
Transcript

Original podcast

Where to listen

About this episode

Production ML systems include more than just the model. In these complicated systems, how do you ensure quality over time, especially when you are constantly updating your infrastructure, data and models? Tania Allard joins us to discuss the ins and outs of testing ML systems. Among other things, she presents a simple formula that helps you score your progress towards a robust system and identify problem areas. Featuring: Tania Allard – Website https://www.bitsandchips.me, GitHub https://github.com/trallard, X https://x.com/ixekChris Benson – Website https://chrisbenson.com, GitHub https://github.com/chrisbenson, LinkedIn https://www.linkedin.com/in/chrisbenson, X https://x.com/chrisbensonDaniel Whitenack – Website https://www.datadan.io/, GitHub https://github.com/dwhitena, X https://x.com/dwhitenaShow Notes: “What’s your ML score” talk https://youtu.be/obLHa21U0qo“Jupyter Notebooks: Friends or Foes?” talk https://youtu.be/vyAG0bPJ6EsJoel Grus’s episode: “AI code that facilitates good science” https://changelog.com/practicalai/51Papermill https://papermill.readthedocs.io/en/latest/nbdev https://www.fast.ai/2019/12/02/nbdev/nbval https://github.com/computationalmodelling/nbvalBooks “DevOps For Dummies” by Emily Freeman https://www.amazon.com/dp/1119552222Upcoming Events: Register for upcoming webinars here https://practicalai.fm/webinars!

Transcript

0:00
47:34

8,012 words · 6 speakers

Speaker names marked are inferred from speaking time and the show’s known hosts — they are not voice-verified.

Page updated · transcript and summary are machine-generated