As AI tools flood hospitals and doctor's offices, a critical question emerges: who decides when machines advise on your health? A 2026 survey found that more than 80 percent of US doctors use AI professionally, more than double the share from 2023. Yet only 8 percent of Americans reported feeling a "great deal" of trust in AI managing their appointments or analyzing their health records, according to an October 2025 KFF poll. This widening gap between what doctors want and what patients accept could undermine the entire promise of medical AI.

Why Are Doctors and Patients So Far Apart on AI Trust?

The disconnect runs deep. Physicians see AI as a powerful tool to keep more accurate notes, act as a second pair of eyes during diagnosis, and monitor patients at risk of deteriorating. Patients, by contrast, worry about losing control and autonomy in their own care. A 2025 survey found that only 32 percent of Americans said they would trust an online health tool using AI to access their medical records and provide personalized health information. This hesitation comes at a time when faith in the healthcare system and the medical profession have already slid, making the stakes even higher.

The anxiety is not unfounded. Recent events have amplified patient concerns. A group of nurses in New York City were recently laid off, with claims that their labor was being replaced by AI. Such incidents fuel fears that AI adoption will prioritize cost-cutting over patient care, even as healthcare leaders insist that's not the goal.

What Does "Human in the Loop" Actually Mean in Practice?

The answer to bridging this trust gap may lie in four words: "human in the loop." This principle means that a doctor or nurse remains the final decision-maker, with AI serving as an assistant rather than a replacement. Surveys show that people are significantly more comfortable with AI as a second opinion than with AI acting independently. Most clinicians also prefer this approach, wanting to use AI to enhance their judgment, not replace it.

"Doctors and nurses and staff always have been interested in primarily making the best decision for the people under their care, and these tools can help with that. The interest in making sure those tools are accurate is high," said Alison Callahan, a research scientist at Stanford University who works on AI programs used in the university's health system.

Alison Callahan, Research Scientist, Stanford University

In practice, "human in the loop" takes several forms across healthcare settings:

• Note-Taking and Summarization: AI tools summarize patient interactions and observations, which a doctor or nurse then reviews before taking action. This is probably the most common AI use patients will encounter.
• Administrative Support: AI handles scheduling follow-up appointments and sends reminders, such as colonoscopy prep instructions, freeing staff for clinical work.
• Diagnostic and Risk Prediction: AI offers a second opinion during emergency room triage, helps prioritize patients, or monitors those at risk of complications using data from wearables or hospital records.

The key difference is that in each scenario, a human reviews the AI's output and makes the final call. A doctor reads the AI-generated summary before ordering a lab test. A nurse reviews the risk prediction before recommending a specialist visit. The machine informs; the human decides.

How to Talk to Your Doctor About AI in Your Care

• Ask Proactively: Don't assume your doctor will volunteer information about AI use. Experts recommend asking directly whether AI is being used in your care, especially for note-taking, record analysis, or diagnostic recommendations.
• Request Transparency Before Consent: Your doctor should explain how AI will be used and ask for your permission before deploying it. If they don't, you have every right to ask. Many patients report they would feel more comfortable with AI if their doctor fully explained it in advance.
• Understand the Specific Role: Ask whether AI is being used as a second opinion, a monitoring tool, or an administrative aid. Understanding the specific function helps you assess whether you're comfortable with it.
• Verify Human Oversight: Confirm that a doctor or nurse will review any AI-generated recommendations or summaries before they affect your care. This is the essence of "human in the loop."

The conversation itself matters. "AI is new, but the trust that serves as the foundation of the physician-patient relationship is not," explained Timothy Keyes, a machine learning scientist at Stanford Health Care. "To that end, I think that conversations about medical AI use should be open, honest, and transparent, just like any other conversations about shared decision-making in the clinical environment should be".

Why Adoption Varies So Much Across Healthcare Systems

One reason patients must be proactive is that AI adoption remains "highly localized," according to Jennifer Goldsack, CEO of the Digital Medicine Society, a nonprofit that works with healthcare providers, drug makers, and government agencies on how to incorporate new technology into clinical care. Different hospitals and doctor's offices are setting up their own programs and protocols. There is no single standard yet. This patchwork approach means your experience with AI in healthcare depends heavily on where you receive care.

Some health systems may prioritize rapid AI adoption and delegate more tasks to these tools, as the recent NYC nurse layoffs suggest. Others may move more cautiously, keeping humans firmly in control. Without clear industry standards or regulatory requirements, the burden falls on patients to understand what's happening in their own care.

The stakes are real. Healthcare AI can improve outcomes, reduce errors, and free clinicians to spend more time with patients. But it can also erode trust if patients feel they've lost agency or if they suspect AI is being used primarily to cut costs rather than improve care. The path forward depends on whether the healthcare industry can honor the principle that patients want to feel empowered and in control, even as AI becomes more entrenched in hospitals and doctor's offices.