Physicians see AI as a tool — and a threat

Physicians see AI as a tool — and a threat © Suriyo - stock.adobe.com

More than half of U.S. physicians are using artificial intelligence (AI) in their daily work, but most of them feel underprepared to manage its risks.

Those are the key findings of a new survey from Inlightened, a Boston-based platform that connects health tech companies with practicing clinicians. The report, “Advancing Responsible AI in Health care: What Doctors Want Innovators to Know,” was based on responses from 72 physicians who were surveyed this spring. There’s a trend of both growing adoption and deep ambivalence about AI’s expanding footprint in health care.

AI use is rising, but confidence is lagging

Fifty-seven percent of responding physicians reported using AI tools in their practice, mostly for tasks like documentation and billing, in the form of chatbots, and even for assistance with diagnostics. Yet only 28% said they feel prepared to fully leverage the tools while safeguarding patients from potential harm.

“America’s doctors are ready and willing to try AI for a number of use cases,” said Shelli Pavone, co-founder and president of Inlightened. “But [they] need the right solutions to demonstrate both the business and [delivery of] care case. The opportunities are vast for companies to close existing gaps — e.g., AI for revenue capture — while addressing clinicians’ concerns, such as AI’s potential to erode trust between a doctor and patient and the question of accountability.”

Physicians cited several reasons for turning to AI:

• 26% said AI tools provide a competitive advantage
• 52% viewed AI as an ally in their current role.
• 40% believed AI could improve billing accuracy and treatment planning.
• 29% said it could boost revenue capture.

At the same time, nearly 4 in 10 respondents (38%) said their organization lacks any guidelines for AI use — raising red flags about accountability, compliance and risk.

Cautious optimism with clear risks

While most clinicians appear hopeful about AI’s long-term impact on the health system, many also flagged serious concerns. Three out of 10 physicians described AI as both an “ally and a threat.”

Among those:

1. 76% worried about being held liable if AI produces inaccurate or misleading data.
2. 57% saw promise in AI’s potential to improve diagnostic accuracy.
3. 23% expressed concern that AI might erode patient trust.

Physicians were particularly candid about what they need to feel more confident using AI. More than half (55%) said real-world case studies from peers would help. Another 45% called for external training led by independent AI or tech experts.

So, what do you want from AI?

When asked what impact they expect AI to have on the U.S. health care system, respondents were generally optimistic.

1. “I believe AI will improve patient outcomes” – 55%
2. “I believe AI will reduce clinical burnout” – 50%
3. “I believe AI will lower health care costs” – 47%
4. “I believe AI will lead to increased data and security breaches” – 42%

“These results mirror the conversations I’m having with colleagues about the promises and risks of AI,” said Oren Mechanic, M.D., M.P.H., MBA, a practicing physician and strategic advisor. “We are currently at an important crossroad that could determine the future of health care in the U.S.”

Mechanic said that, with appropriate leadership and guidance — especially around compliance, privacy and trust — AI could evolve into a true partner in care delivery. Getting there, though, will require more than just tech adoption.

“As with many health care innovations, we will soon better understand all the ways this technology can help us improve our patients’ — and our own — experience with the health care system,” he said.

Industry opportunities and responsibilities

For innovators in the MedTech space, the report offers a roadmap: physicians are open to AI solutions that improve documentation, streamline billing and support decision-making — but they’re wary of solutions that lack transparency or human-centered design.

“The companies that position themselves — and their solutions — as physicians’ advocates will stand out and impact the future of health care,” Pavone said.