Artificial intelligence chatbots are increasingly being used by individuals seeking health advice, but a general practitioner warns that the information provided can be inaccurate and even life-threatening. Dr. Philippa Kaye, a GP with over 20 years of experience, stated that these AI tools, including ChatGPT and Gemini, are not doctors and are currently making mistakes that pose risks to patient lives.
Millions of people are turning to AI chatbots for health inquiries, with approximately a quarter of ChatGPT's weekly users submitting health-related questions. This trend has prompted concern from health charities, such as The Eve Appeal, a UK-based gynecological cancer charity. When tested with classic warning signs of gynecological cancers, ChatGPT failed to identify potential cancer as a cause for symptoms like persistent bloating or vulval itching.
A survey of over 2,000 UK women revealed that nearly 10% had consulted AI platforms for symptoms. Of those, a quarter felt reassured by the chatbot's response, and fewer than a third were encouraged to see a doctor. This can be particularly dangerous as early diagnosis is crucial for effective cancer treatment and improved survival rates.
Dr. Kaye suggests that a fundamental issue with AI is its design to be agreeable and user-pleasing, which can lead to overly positive or reassuring responses that discourage further medical investigation. The framing of a question significantly impacts the AI's answer; requesting reassurance can result in a less critical assessment of symptoms.
While some AI tools include disclaimers about potential inaccuracies, Dr. Kaye questions the reliability of advice that requires users to constantly double-check its validity, contrasting it with the established protocols and accountability of human medical professionals.
Dr. Kaye highlighted that human doctors possess vital information that AI cannot access, such as a patient's full medical history, allergies, and family history. AI also lacks the ability to conduct physical examinations, order tests, or ask nuanced follow-up questions essential for accurate diagnosis. Furthermore, licensed medical practitioners undergo regular appraisals and revalidation, with established channels for complaints and regulatory oversight, unlike AI chatbots.
Despite the challenges in accessing primary care, Dr. Kaye pointed to the increasing availability of digital tools like the NHS app, which facilitates repeat prescriptions, access to health records, and appointment booking, often more efficiently than traditional methods. She urged individuals experiencing health concerns to consult their real doctors rather than relying on AI chatbots.