ChatGPT is probably nicer than your doctor

From: POLITICO Future Pulse - Monday May 01,2023 06:01 pm
The ideas and innovators shaping health care
May 01, 2023 View in browser
 
Future Pulse

By Ruth Reader, Ben Leonard and Erin Schumaker

CHECKUP

Text from the ChatGPT page of the OpenAI website is shown in this photo in New York, Feb. 2, 2023.

ChatGPT's compassion stands out, a new study says. | AP Photo/Richard Drew

Time pressures and health care bureaucracy have eroded the bedside manner of many doctors. Burned-out physicians have to balance tight appointment times with copious administrative work giving them less space for humanity.

For more compassionate care, it may be time to bring in the robots.

Yes, seriously.

A new study found that the artificial intelligence bot ChatGPT gave not only more thorough, but also more empathetic, responses to patient questions than those provided by an actual doctor.

How it worked: Researchers took 195 questions and answers posted on the Reddit forum /AskDocs, a community where individuals post their most pressing health concerns and doctors respond, and let ChatCPT have a go.

A panel of five experts, all with some form of clinical licensing, evaluated the physician responses against ChatGPT’s answers and found that 78 percent of the time ChatGPT provided better answers.

Takeaway: “It's not only what you say, but also how you say it,” said John Ayers, the lead author on the study and associate professor of medicine at the University of California San Diego.

Ayers believes ChatGPT could, if regulated appropriately, both help reduce doctor workload and help patients achieve better outcomes cost effectively.

There’s also an opportunity, he said, to test whether bots can help patients stay on track with medications, follow doctors’ orders, and come to their next appointment.

Even so: Check out our next item on new evidence on ChatGPT’s deficiencies.

 

DON’T MISS THE POLITICO ENERGY SUMMIT: A new world energy order is emerging and America’s place in it is at a critical juncture. Join POLITICO on Thursday, May 18 for our first-ever energy summit to explore how the U.S. is positioning itself in a complicated energy future. We’ll explore progress on infrastructure and climate funding dedicated to building a renewable energy economy, Biden’s environmental justice proposals, and so much more. REGISTER HERE.

 
 
WELCOME TO FUTURE PULSE

National Arboretum, Washington, D.C.

National Arboretum, Washington, D.C. | Shawn Zeller

This is where we explore the ideas and innovators shaping health care.

Pounding the pavement could actually be good for your knees and other joints, according to mounting evidence. One study, for instance, found that the arthritis rate among marathon runners was half the expected rate.

Share any thoughts, news, tips and feedback with Ben Leonard at bleonard@politico.com, Ruth Reader at rreader@politico.com, Carmen Paun at cpaun@politico.com or Erin Schumaker at eschumaker@politico.com.

Send tips securely through SecureDrop, Signal, Telegram or WhatsApp.

Today on our Pulse Check podcast, Ruth talks with Ben about legislation that would give Medicare patients permanent access to virtual care and the DEA regulation that could simultaneously curtail telemedicine access to some drugs.

Play audio

Listen to today’s Pulse Check podcast

TECH MAZE

CHICAGO, IL - JULY 2: A student in Arlene Lebowitz's third-grade class reads school work during summer school July 2, 2003 in Chicago, Illinois. A record number of students are expected at summer school due to a strong showing for a new voluntary program for mid-tier students and strict application of non-ITBS (Iowa Tests of Basic Skills) test promotion standards. (Photo by Tim Boyle/Getty Images)

Humans are still doing better on exams than ChatGPT. | Getty Images

ChatGPT may know how to spread the kindness, but its health care expertise is still a work in progress.

In fact, if ChatGPT were a medical student, it’d be in danger of failing out.

That’s judging by the artificial intelligence bot’s performance on medical board certification exams, according to two new reports.

JAMA Opthalmology reported that researchers asked the chatbot 125 questions for board certification in ophthalmology.

It whiffed – a lot, getting just 58 of them correct, or 46 percent.

ChatGPT, made by the firm OpenAI, did well with general medicine, getting 79 percent of those questions correct, but struggled with more specific questions about the eye.

A second research letter from Stanford researchers published in JAMA Otolaryngology -- Head & Neck Surgery found that the technology came up with helpful postoperative instructions.

But when compared to Google Search and guides produced by health care institutions, ChatGPT’s instructions were harder to understand and were less specific.

Even so: ChatGPT has passed a number of standardized tests, including the U.S. Medical Licensing Exam and previous research has shown that the chatbot is decent at answering relatively simple health questions.

Still, regulators and health care industry leaders are suggesting a cautious approach to incorporating artificial intelligence, recommending starting with lower-risk use cases with guardrails in place.

 

GET READY FOR GLOBAL TECH DAY: Join POLITICO Live as we launch our first Global Tech Day alongside London Tech Week on Thursday, June 15. Register now for continuing updates and to be a part of this momentous and program-packed day! From the blockchain, to AI, and autonomous vehicles, technology is changing how power is exercised around the world, so who will write the rules? REGSITER HERE.

 
 
WASHINGTON WATCH

FILE - A mother holds a bottle of baby formula as she feeds her infant son, Friday, May 13, 2022, in San Antonio. Federal health officials are warning parents of newborns, Thursday, March 2, 2023, to sterilize equipment used for both bottle- and breast-feeding after a baby died last year from a rare infection tied to a contaminated breast pump. (AP Photo/Eric Gay)

A new law mandating more accommodations for breast-pumping mothers is now in effect. | AP

The PUMP Act — which broadened requirements for employers to offer accommodations for pumping breast milk during the work day — is now the law of the land.

It’s a win for moms and for the companies catering to them.

The new law, which Congress passed with December’s year-end spending bill, took effect on Friday and adds to mandates from the Affordable Care Act requiring accommodations for employees to pump, in private, at work.

The PUMP Act goes further, covering more employers.

Win for health tech: Companies offering virtual lactation consultations have applauded the move, arguing it boosts access to assistance.

Simplifed, which provides virtual breastfeeding support, is teaming up with pump company Willow to educate parents on the new law, what it means for them and how to talk to their employers about it.

“There's so much load on moms coming back to work already," said Laura Chambers, CEO of Willow. "The more we can take the load off them and give other people the tools to be proactive about it will make a huge difference to how this is implemented."

What’s next: Another push to expand the law still further.

Andrea Ippolito, CEO of Simplifed, said the PUMP ACT didn’t go far enough because it exempts companies with fewer than 50 employees — a significant portion of employers – “if such requirements would impose an undue hardship.”

“This is a stepping stone,” Ippolito said.

 

Follow us on Twitter

Ben Leonard @_BenLeonard_

Ruth Reader @RuthReader

Carmen Paun @carmenpaun

Erin Schumaker @erinlschumaker

 

Follow us

Follow us on Facebook Follow us on Twitter Follow us on Instagram Listen on Apple Podcast
 

To change your alert settings, please log in at https://www.politico.com/_login?base=https%3A%2F%2Fwww.politico.com/settings

This email was sent to by: POLITICO, LLC 1000 Wilson Blvd. Arlington, VA, 22209, USA

Please click here and follow the steps to .

More emails from POLITICO Future Pulse

Apr 28,2023 06:02 pm - Friday

The elusive ERA's health implications

Apr 27,2023 06:02 pm - Thursday

The battle royale over noncompetes

Apr 26,2023 06:01 pm - Wednesday

Surprise! We’re breathing cleaner air

Apr 25,2023 06:01 pm - Tuesday

Rep. Barbara Lee on ending AIDS by 2030

Apr 24,2023 06:01 pm - Monday

Home care: Medicare panacea or mirage?

Apr 21,2023 06:01 pm - Friday

African drugmakers’ tough sell

Apr 20,2023 06:01 pm - Thursday

UN: Stop fretting about fertility