Artificial intelligence is rapidly transforming the healthcare landscape, presenting both opportunities and challenges for patients and medical professionals. While a significant majority of U.S. doctors are now using AI in their practice, public trust remains a concern, with many patients expressing apprehension about AI managing appointments or analyzing their health records. A 2025 KFF poll indicated that only 8 percent of Americans felt a great deal of trust in AI for such tasks.
Despite public hesitancy, clinicians and administrators view AI as a valuable tool for streamlining treatments and improving patient care. A 2026 survey revealed that over 80 percent of U.S. doctors utilize AI professionally, a substantial increase from 2023. Physicians are leveraging AI for tasks such as generating more accurate patient notes, acting as a diagnostic aid, and monitoring patients at risk of health deterioration.
This disparity in perception highlights a potential for increased distrust in a healthcare system already grappling with declining faith. Patients increasingly desire agency in their health decisions, leading to questions about how to maintain control as AI becomes more prevalent in hospitals and clinics.
The principle of the “human in the loop” is emerging as a critical framework for the ethical integration of AI in medicine. This approach suggests that AI should function as an assistant or a second opinion rather than an autonomous decision-maker. Surveys indicate that patients are more comfortable with AI assisting their doctor than acting independently. Similarly, most clinicians prefer to use AI as a supplementary tool, not a replacement for their professional judgment. Concerns about AI potentially displacing healthcare workers, as suggested by recent layoffs of NYC nurses who claim their roles were replaced by AI, underscore the importance of this collaborative model.
“Doctors…and nurses and staff always have been interested in primarily making the best decision for the people under their care — and these tools can help with that,” said Alison Callahan, a research scientist at Stanford University. “The interest in making sure those tools are accurate is high.”
AI's current applications in medicine are diverse. On an individual level, people are using public AI chatbots like ChatGPT to inquire about symptoms or health data from wearable devices. Physicians also consult these large language models for research updates and clinical guidance. At institutional levels, hospitals are employing AI to manage administrative tasks, such as scheduling appointments and sending patient reminders for procedures like colonoscopy prep. AI is also being developed for diagnostic and risk prediction, potentially offering second opinions in emergency triage or monitoring patient data to identify those at higher risk of complications.
However, AI adoption in healthcare is still characterized as “highly localized,” according to Jennifer Goldsack, CEO of the Digital Medicine Society. The integration varies significantly depending on the individual healthcare provider or system, with many developing their own protocols. This variability emphasizes the need for patients to proactively inquire about AI's role in their care.
Experts advise patients to feel assured that healthcare professionals intend to maintain human oversight. “It will be a doctor who is going to be reading that summary or a nurse who is going to be reading that summary and then taking an action to order a lab or put a recommendation in for a follow-up appointment,” Callahan explained. “There is high interest in making sure that that is the right decision for that person. That hasn’t changed.”
To foster comfort and informed consent, experts recommend patients ask direct questions. These include inquiring about how AI will be used in their care, how their data is protected, and whether they can opt out of AI services. Timothy Keyes, a machine learning scientist at Stanford Health Care, stressed the importance of open, honest, and transparent conversations about AI use, mirroring standard practices for shared decision-making.
For instance, AI-powered note-taking is becoming common, with some doctors proactively seeking patient consent. This application is often viewed favorably as it can reduce physician burnout and save time. Patients are encouraged to disclose their use of AI tools, such as health chatbots, to their doctors to ensure comprehensive understanding and care.
Key questions patients can ask include:
- Will AI be used in my care and how?
- How is my data being protected?
- Can I opt out of any AI services that I do not feel comfortable with?
- How is the health system or clinic ensuring the AI system is working as intended?
Ultimately, understanding how AI influences healthcare decisions is paramount. Callahan suggests focusing on the factors informing a doctor's recommendation, regardless of AI's involvement. “I actually think if they can point to the part of your health that is connected to the decision, whether or not an AI tool helped to make that connection is secondary to their ability to communicate effectively to me about it, and help me to feel engaged in making a decision about my own care,” she stated.
As AI continues to evolve within medicine, open dialogue between patients and providers is the most effective way to navigate its integration and ensure patient empowerment.