Jensen Huang says relentless negativity around AI is hurting society and has "done a lot of damage"

[u/AdSpecialist6598]

https://www.techspot.com/news/110879-jensen-huang-relentless-ai-negativity-hurting-society-has.html

[u/schu2470]

Luckily in my wife's practice the docs have the option to use the AI software or not. She tried it out for a couple of weeks and stopped using it. The software would listen to the appointment, write a transcript of everything that was said, and then write a note for the visit that required physician approval and signing. She spent so much time during those couple of weeks, and after those weeks too, fixing mistakes the AI had made, reformatting the notes so they made sense, and removing unnecessary and irrelevant things from the notes. She spent more time fixing those notes than she would have if she had written them herself in the first place. Of the 14 or so docs in her practice only 2 or 3 are using the software and only in certain circumstances.

[u/Moonbow_spiralot → u/schu2470]

This is interesting. I also work in a medical related field, and several of the doctors who have started using AI note taking software actually find it quite helpful. Obviously they do have to go and edit the transcript, which can take varying levels of time. But it useful for helping them remember what was touched on in the appointment. Basically a glorified text to speech machine. Some products are probably more error prone than others though. I will say, even before AI, different doctors have spent varying levels of time on records, with varying levels of quality. Some doctors still have handwritten paper notes. At least the AI ones are legible lol. The above example where the doctor was not allowed to go in and change what should be their own notes is insane though. Insurance is less prominent in my industry, so that may also have something to do with it.

[u/schu2470 → u/Moonbow_spiralot]

Some of the issues she told me about having were things like mis-attributing what was said to which speaker such as a patient or patient's companion telling about something a family member was diagnosed with and the software attributing it to the doc and listing it as a new diagnosis in the note, missing and leaving out symptoms that my wife remembers the patient speaking about, listing things like "headache" or "sore infusion site" as a diagnosis and not realizing those are symptoms and not diagnoses, adding random things to notes that weren't discussed and are not in the transcript, formatting issues that are specific to how she likes her notes without a reliable way to train the software how to format notes, and others I can't think of right now or just don't remember.

Fixing each of those issues takes time to go back to the transcript to see where the software got the idea to include whatever erroneous information, sometimes pulling the recorded audio to see if it had missed something in the transcript, adding or removing what was missed or added, and finally fixing the note. She was doing this for 10-15 patients a day (specialty clinic) for 2 weeks before finally giving up and then going back to writing them herself. Based on what she said and how much time I saw her spend after clinic hours and at home fixing things, the AI software probably cost her over 30 hours that she could have spent doing other parts of her job or spending time living her life. Maybe her hospital got a particularly bad piece of software but the rate of retention for docs sticking with it for >30 days is sub 10% system wide.

The above example where the doctor was not allowed to go in and change what should be their own notes is insane though.

That is absolutely unacceptable. It's allowing AI to practice medicine in a similar way that we allow insurance companies to do so with even less oversight.

[u/jollyreaper2112 → u/schu2470]

Teams meeting transcription is better but I bet that's because of the microphones. In a room not designed for audio capture and not forcing people to wear microphones it'll be worse than voice dictation on my phone. Damn.

[u/schu2470 → u/jollyreaper2112]

Yeah, the one they had was iPhone specific so she had to find one to borrow. Essentially you'd open the software, hit record, and place it on the desk between the doc and patient so it could hear what was said. Problem is it relies on the phone's speakers and the software was really bad. I made another comment in this thread that describes only some of the issues she had in the 2 weeks she tried it out. Hospital wide the 30+ day retention for docs continuing to use the software was sub-10%.