ChatGPT can pass the MRCP exam but makes some pretty basic errors, researchers find

John Walton/PA Wire

By Emma Wilkinson

ChatGPT is able to pass the MRCP written exam with ease but it is still prone to quite basic mistakes – sometimes multiple mistakes – that would equate to serious harm should it be used in tools that support clinical decision making, researchers say.

It highlights that better understanding of the frequency and types of errors made by large language models is needed before the technology can have a useful and trusted place within healthcare.