ChatGPT-fabricated Abstracts in Gynecologic Oncology with Gabriel Levin and Behrouz Zand

IJGC Podcast

In this episode of the IJGC podcast, Editor-in-Chief Dr. Pedro Ramirez is joined by Drs. Gabriel Levin and Behrouz Zand to discuss ChatGPT-fabricated abstracts in gynecologic oncology. Dr. Gabriel Levin is a gynecologic oncology Fellow at McGill University. His research encompasses population database studies with clinical implication and innovations in medical education and health care. He has published more than 180 peer reviewed original articles.. Dr. Behrouz Zand is a gynecologic oncologist at Houston Methodist Hospital's Neal Cancer Center and Department of Obstetrics and Gynecology, and an assistant professor at Weill Cornell College at Houston Methodist Academic Institute. Specializing in innovative cancer care and clinical trials, he is passionate about integrating AI in medicine, a recent alumnus of the physician program at MIT for AI integration in healthcare. Dr. Zand combines cutting-edge research with compassionate patient care to advance the field.

Highlights:

Reviewers had difficulty in discriminating ChatGPT-written abstracts. Reviewers correctly identified only 46.3% of ChatGPT-generated abstracts, with human-written abstracts slightly higher at 53.7%.

Senior reviewers and those familiar with AI had higher correct identification rates, with senior reviewers at 60% and juniors/residents at 45%. Experience and familiarity with AI were independently associated with higher correct identification rates.

ChatGPT assists researchers by generating reviews, summaries, and enhancing writing clarity, but it raises ethical concerns and could diminish human expertise. For non-English speaking authors, it improves writing quality and clarity. In scientific writing, it enhances clarity, summarizes concisely, brainstorms ideas, assists with terminology, and offers data interpretation, augmenting human expertise.

ChatGPT and AI in scientific writing can lead to ethical issues, factual inaccuracies, and may eventually diminish human expertise and critical thinking.