Kintsugi’s AI software program analyzes the human voice to detect despair and anxiousness, providing clinicians “a extra well-rounded, 360-view of the affected person” that typically will get misplaced in digital care.
“The fast brown fox jumps over the lazy canine,” Rima Seiilova-Olson says slowly and emphatically over Zoom.
The easy sentence holds huge worth for psychological well being care, she explains, smiling as if to acknowledge that it could be lower than apparent how a foolish phrase may very well be so significant to a pc programmer and chief of a synthetic intelligence startup.
The brief saying accommodates each letter of the alphabet and phoneme within the English language, says Seiilova-Olson, an immigrant from Kazakhstan who’s cofounder and chief scientist of Kintsugi Mindful Wellness. Kintsugi believes these sounds provide invaluable perception that may assist psychological well being suppliers higher assist individuals with despair and anxiousness.
The Bay Space-based firm is constructing AI software program that analyzes brief clips of speech to detect despair and anxiousness. This so-called voice biomarker software program is being built-in into medical name facilities, telehealth companies and distant monitoring apps to display screen and triage sufferers reaching out for assist, serving to suppliers extra shortly and simply assess their wants and reply.
“There’s simply not quite a lot of visibility as to who’s severely depressed or anxious.”
Seiilova-Olson, 36, first met co-founder and CEO Grace Chang, 40, a Taiwanese immigrant now based mostly in Berkeley, in 2019 at an open AI hackathon in San Francisco. Shocked to cross paths at a male-dominated occasion, the ladies started evaluating notes about their respective private challenges making an attempt to entry psychological well being care: Seiilova-Olson had struggled to safe a therapist throughout postpartum despair together with her first little one, and when Chang had wanted her personal assist, she mentioned it had taken months for anybody from Kaiser to name her again.
“Residing within the Bay Space, you’ll be able to push a button and a automotive can come to you or meals can come to you,” Chang says. “However this was actually a problem.”
As engineers, they considered the dilemma in a different way than clinicians may.
“We noticed this as an infrastructure drawback, the place you might have so many individuals making an attempt to jam via that entrance door,” Chang explains. “However there’s simply not quite a lot of visibility as to who’s severely depressed or anxious, who’s low-to-moderate. And if we might present this data to these frontline practitioners, then we might possibly have a chance to drastically alleviate that bottleneck.”
Kintsugi was born out of that concept in 2019. It sits in a aggressive house of well being tech startups like Ellipsis Health and Winter Light Labs which are utilizing voice biomarkers to detect psychological well being or cognitive points, constructed on analysis displaying that sure linguistic patterns and traits of an individual’s voice could be correlated with psychiatric or neurological circumstances. Kintsugi final yr raised $8 million in seed funding led by Acrew Capital, and in February, introduced it had closed a $20 million Collection A spherical led by Perception Companions, which valued the corporate at almost $85 million, in keeping with PitchBook.
In-person psychological well being amenities usually use questionnaires to gauge the severity of sufferers’ anxiousness or despair, measures generally known as PHQ-9 and GAD-7 scores. However throughout telehealth visits or telephone consults — the place face-to-face interplay is misplaced, making it tougher to select up on signs — Kintsugi’s expertise helps to fill that hole.
Nicha Cumberbatch, assistant director of public well being at Spora Health, a supplier targeted on well being fairness and other people of shade, makes use of Kintsugi’s software program to evaluate ladies in its all-virtual, doula-led maternal well being program, Spora Mommas. The voice evaluation instrument, which Spora started utilizing for affected person consultations a number of weeks in the past, has helped Cumberbatch establish ladies who’re, or could also be susceptible to, experiencing anxiousness and despair earlier than, throughout or after their pregnancies. When a affected person begins chatting with a Spora clinician or doula on Zoom, Kintsugi’s AI begins listening to and analyzing her voice. After processing 20 seconds of speech, the AI will then spit out the affected person’s PHQ-9 and GAD-7. The worker can then use that psychological well being rating to resolve what extra testing could also be wanted and the way greatest to advise or direct the affected person to sources — like a psychiatrist, cognitive behavioral therapist or obstetrician.
Cumberbatch says Kintsugi’s expertise is permitting her to “preserve a extra watchful eye” on her sufferers “after which transfer ahead with proactive suggestions round mitigating their signs.” And whereas it’s not meant to switch clinicians or formal medical evaluations, she provides, it may be used as a screening instrument to “permit us to have a extra well-rounded, 360-view of the affected person when we do not have them in entrance of our face.”
“That expertise… [allows] us to have a extra well-rounded, 360-view of the affected person when we do not have them in entrance of our face.”
Dr. Jaskanwal Deep Singh Sara, a Mayo Clinic heart specialist who has collaborated with Ellipsis and led analysis on potential makes use of of voice biomarkers for cardiology, cautions that whereas the expertise is promising for well being care, the sector has an extended method to go to make sure that it’s correct, protected and helpful for sufferers and clinicians alike.
“It is not prepared for primetime by any stretch of the creativeness but,” Dr. Sara says. Research in psychiatry, neurology, cardiology and different areas have proven an affiliation between voice biomarkers and numerous circumstances or illnesses, however they haven’t proven how this relationship can be utilized to enhance medical outcomes, he says. Such analysis is “not the identical as saying, ‘How can we instrumentalize it in medical apply, and the way possible is it? How efficient is it in gauging a person’s medical trajectory?’” he explains. “If it would not present any advantages when it comes to how we handle them, then the query is: why would you do it?”
He says addressing these questions is “considered one of many subsequent steps that we have now to undertake on this” and that bigger medical trials are wanted to reply them. “If it makes well being care supply cheaper or extra environment friendly, or if it improves outcomes for sufferers, then that is nice,” he provides. “However I believe we have to reveal that first with medical trials, and that hasn’t been accomplished.”
To handle these points and validate its software program, Kintsugi is conducting clinical studies, together with with the College of Arkansas for Medical Sciences, and the Nationwide Science Basis has awarded Kintsugi a number of grants to ramp up its analysis. The corporate can be pursuing FDA “de novo” clearance and persevering with to construct its personal dataset to enhance its machine studying fashions. (Information and insights from Kintsugi’s voice journaling app, in addition to conversations with name facilities or telehealth suppliers and medical collaborations with numerous hospitals, all develop into a part of an infinite dataset that feeds Kintsugi’s AI.) Seiilova-Olson says this self-generated, unfettered proprietary dataset is what units Kintsugi aside within the AI well being care house — the place many applied sciences are reliant on outdoors information from digital well being information.
That assortment of troves of information on people’ speech could be regarding — notably within the psychological well being and wellness house, which is broadly thought-about a regulatory Wild West. (These services are sometimes not topic to the identical legal guidelines and stringent requirements that govern how licensed clinicians present formal medical care to sufferers.) However Kintsugi’s founders say that affected person privateness is protected as a result of what issues for its expertise is just not what individuals are saying, however how they’re saying it. Sufferers are additionally requested for his or her consent to be recorded and care is just not affected by their determination to choose in or choose out, in keeping with the founders.
Kintsugi says it has served an estimated 34,000 sufferers. The corporate is at the moment working with a big well being system with 90 hospitals and clinics throughout 22 states, and they’re energetic in a care administration name middle that companies roughly 20 million calls per yr. Additionally it is partnering with Pegasystems, which gives customer support instruments for well being care and different industries, to assist payers and suppliers deal with inbound calls. Chang says different clients embrace Fortune 10 enterprise payers, pharmaceutical organizations and digital well being functions targeted on distant affected person monitoring, however that she couldn’t but share their names. Kintsugi’s medical companions embrace Kids’s Hospital Colorado, Joe DiMaggio Kids’s Hospital in Florida, Chelsea and Westminster Hospital in London and SJD Barcelona Kids’s Hospital in Spain, Chang mentioned.
Prentice Tom, Kintsugi’s chief medical officer, provides that it’s working with the College of Arkansas to discover how the instrument can be utilized to probably establish sufferers with suicidal ideation, or elevated or extreme suicide threat, in addition to with Loma Linda College, to take a look at how the expertise can be utilized to identify burnout amongst clinicians. The staff can be on the lookout for methods to develop availability and makes use of for youthful and aged sufferers, in addition to for maternal and postpartum populations. And past sufferers themselves, it’s maybe nurses who’re benefiting most from Kintsugi’s work, in keeping with the founding staff: having a triage instrument that helps cut back administrative work or the time spent asking generic questions permits nurses to extra seamlessly transfer sufferers of their journey.
However Tom, a Harvard-trained emergency drugs doctor and former college member at Stanford College’s Division of Emergency Drugs, says Kintsugi is now doing way over addressing infrastructure points alone. It’s democratizing entry to psychological well being care, Tom mentioned, transferring away from a physician-centric paradigm that caters extra to individuals with important sufficient despair that they require medical analysis.
“This instrument really creates a view of psychological well being when it comes to psychological wellness,” Tom mentioned, “the place everybody has the chance to grasp the place they sit on the spectrum and that truly stratifies therapy choices properly past the present infrastructure.”
MORE FROM AI 50 2022
