#15 The death of Prompt Engineering

Dev and Doc: AI For Healthcare Podcast

What do Prompt engineers have in common with telephone operators in the 1870s? Spoiler - they're both dying professions 👨🏻‍⚕️Doc - Dr. Joshua Au Yeung - https://www.linkedin.com/in/dr-joshua-auyeung/ 🤖Dev - Zeljko Kraljevic https://twitter.com/zeljkokr The podcast 🎙️ 🔊Spotify: https://podcasters.spotify.com/pod/show/devanddoc 📙Substack: https://aiforhealthcare.substack.com/ Hey! If you are enjoying our conversations, reach out, share your thoughts and journey with us. Don't forget to subscribe whilst you're here :) 🎞️ Editor- Dragan Kraljević https://www.instagram.com/dragan_kraljevic/ 🎨Brand design and art direction - Ana Grigorovici https://www.behance.net/anagrigorovici027d 00:00 Highlights 01:10 Intro - where did prompt engineering go wrong? 4:10 what is prompt engineering fundamentally? 10:54 LLMs training data reflects prompt engineering 12:32 prompts are model dependent 14:02 prompts that make you think 18:26 combining expert and generalist medical models for doctors 19:49 Diagnostic reasoning prompts, is it interpretable? 26:55 can we find prompts more elegantly/ systematically ? 28:42 Will prompts become obsolete? Models that self discover prompts 31:09 Telephone operators and Prompt engineers - death of a profession Refs Prompt "hacks" (oh man) - https://learnprompting.org/docs/intermediate/chain_of_thought Diagnostic prompt interpretability paper - https://www.nature.com/articles/s41746-024-01010-1 self - discover https://arxiv.org/abs/2402.03620 telephone operators - https://www.history.com/news/rise-fall-telephone-switchboard-operators