Can you help me construct a realistic scenario where an Allstate employee would have any incentive to review any of the claims denied by this system? Or where a supervisor would have any incentive to encourage them to do so?
Denied by an Algorithm
Insurance company Allstate has revealed that almost all of the communications its reps send out to claimants are now written by AI, the Wall Street Journal reports.
Allstate chief information officer Zulfi Jeevanjee told the WSJ that AI-generated emails tend to be less accusatory and jargony.
Of course, the tech Allstate is making use of, which is based on OpenAI's GPT large language models, is far from perfect.
"The claim agent still looks at them just to make sure they’re accurate, but they’re not writing them anymore," Jeevanjee told the WSJ.
Despite Jeevanjee's reassurances that human staffers look over the output of an AI for accuracy, we've already seen the tech cause plenty of chaos.
In the medical industry, for instance, "hallucinating" AI models have been shown to still make easily avoidable mistakes.
Health insurance company UnitedHealthcare, whose CEO was gunned down late last year, is also facing a class action lawsuit over its use of AI to often wrongfully deny claims.
In fact, UnitedHealthcare is only one of three insurance companies in the US facing class action lawsuits after algorithms denied potentially lifesaving care.
Competitor Cigna was recently accused of denying more than 300,000 claims in just two months, spending a scant 1.2 seconds on average on each one.
Jeevanjee argues that the tech will allow reps to better understand the needs of customers.
"If I think about the insurance industry in general, we haven’t really done a great job of being customer obsessed," he told the WSJ. "That’s really what I’m trying to drive."