24 | Cathy O'Neil, Algorithm Auditor, Author of WMathD

The Performance Audit Report

Our guest is Cathy O'Neil, author of Weapons of Math Destruction: how big data increases inequality and threatens democracy.
Cathy joined us to discuss critical aspects for auditors to consider, including:

• The human element: why understanding 'for whom an algorithm might fail' is more important than the detailed technical design of an algorithm.
• Algorithm testing: the importance of post-deployment testing to ensure there are no unintended adverse outcomes.
• Setting standards: the need for industry-wide standards so that regulators can ensure there is no bias or discrimination in how algorithms operate.
• Laggers and leaders: the four big industries/domains using algorithms that need to step up audit in their space and how law-makers and regulators are catching up.
• Emerging AI, e.g. language models/chatbots - why trust by users is key, and the pros and cons of using these models.

Links

• Cathy's company, ORCAA
• Weapons of Math Destruction (book)
• This episode's web page: https://pareports.com/podcast/24

About this podcast

The podcast for performance auditors.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by PA Reports - Performance Audit Research.
Get updates
New episodes, and a fortnightly newsletter with a selection of PA reports and practices from audit offices.
https://pareports.com/#cta-subscribe

This is a public episode. If you would like to discuss this with other subscribers or get access to bonus episodes, visit performanceaudit.substack.com