At the HLTH conference I talked with CEO of Infermedica, Piotr Orzechowski, and also had a quick word with VP of Marketing Marcus Gordon. Infermedica has been around over a decade, and has been a slow burner in the symptom checker and patient digital front door market. But now it has a lot of clients and deals and its API is hiding behind several big names including Optum & Microsoft. Piotr graciously let me butcher his name, and still told me about how their model works and how LLMs will change it.–Matthew Holt
There Needs to Be an “AI” in “Med Ed”
By KIM BELLARD
It took some time for the news to percolate to me, but last month the University of Texas San Antonio announced that it was creating the “nation’s first dual program in medicine and AI.” That sure sounds innovative and timely, and there’s no question that medical education, like everything else in our society, is going to have to figure out how to incorporate AI. But, I’m sorry to say, I fear UTSA is going about it in the wrong way.
UTSA has created a five year program that will result in graduates obtaining an M.D. from UT Health San Antonio and a Master of Science in Artificial Intelligence (M.S.A.I.) from UTSA. Students will take a “gap year” between the third and fourth year of medical school to get the M.S.A.I. They will take two semesters in AI coursework, completing a total of 30 credit hours: nine credit hours in core courses including an internship, 15 credit hours in their degree concentration (Data Analytics, Computer Science, or Intelligent & Autonomous Systems) and six credit hours devoted to a capstone project.
“This unique partnership promises to offer groundbreaking innovation that will lead to new therapies and treatments to improve health and quality of life,” said UT System Chancellor James B. Milliken.
“Our goal is to prepare our students for the next generation of health care advances by providing comprehensive training in applied artificial intelligence,” said Ronald Rodriguez, M.D., Ph.D., director of the M.D./M.S. in AI program and professor of medical education at the University of Texas Health Science Center at San Antonio. “Through a combined curriculum of medicine and AI, our graduates will be armed with innovative training as they become future leaders in research, education, academia, industry and health care administration. They will be shaping the future of health care for all.”
Dhireesha Kudithipudi, a professor in electrical and computer engineering who was tasked with helping develop the university’s AI curriculum, told Preston Fore of Fortune:
In lots of scenarios, you might see AI capabilities are being very exaggerated—that it might replace physicians and so forth. But I think our line of inquiry was guided in a different way, in a sense how we can promote this AI physician interaction-AI patient interaction, bringing humans to the center of the loop, and how AI can enhance care or emphasize more patient centric attention.
OK, fabulous. But, you know, computers have been integral to healthcare for decades, especially the past 15 years (due to EMRs), and we don’t expect doctors to get Masters in Computer Science. We’re just happy when they can figure out how to navigate the interfaces.
To be honest, I was expecting more from UT.
Continue reading…Nabla CoPilot– the new ambient EMR note taker that snagged Permanente
I got up super early on a Sunday (in Vegas no less!) to meet Delphine Groll, COO and Alexandre Lebrun, CEO of Nabla. I have heard directly from doctors a lot about their CoPilot product being adopted as a less expensive version than Nuance or Abridge, and wanted to see what the fuss was about. They gave me a demo of their ambient AI medical note taker and it is very impressive–you’ll see a little bit of my demo and the resulting note in the interview. They were a little shy on Sunday to tell me about their relationship with the Permanente group but between Jay Parkinson and Fierce Healthcare, the beans are well and truly spilled now, and they are apparently soon to be available in every Permanente region. I suspect because of that the integration with Epic that Alexandre mentioned will be full speed ahead!–Matthew Holt
Altman, Ive, and AI
BY KIM BELLARD
Earlier this year I urged that we Throw Away That Phone, arguing that the era of the smartphone should be over and that we should get on to the next big thing. Now, I don’t have any reason to think that either Sam Altman, CEO of OpenAI, and Jony Ive, formerly and famously of Apple and now head of design firm LoveFrom, read my article but apparently they have the same idea.
Last week The Information and then Financial Times reported that OpenAi and LoveFrom are “in advanced talks” to form a venture in order to build the “iPhone of artificial intelligence.” Softbank may fund the venture with as much as $1b. There have been brainstorming sessions, and discussions are said to be “serious,” but a final deal may still be months away. The new venture would draw on talent from all three firms.
Details are scare, as are comments from any of the three firms, but FT cites sources who suggest Mr. Altman sees “an opportunity to create a way of interacting with computers that is less reliant on screens.” which is a sentiment I heartily agree with. The Verge similarly had three sources who agreed that the goal is a “more natural and intuitive user experience.”
Continue reading…The Carenostics Interview
In my other day job of advising companies, I was introduced to Carenostics by my friends at Bayer G4A. This is a super interesting company which is using AI to diagnose serious chronic diseases like kidney disease, asthma, and others much earlier. So far they are working with health systems like Hackensack in NJ and the VA, and have just raised a $5m round. Last week I spoke with father and son team, Kanishka Rao, COO & Bharat Rao, CEO. In particular look out for Bharat’s explanation of what has to go on behind the curtain to make AI become effective.
The Times They Are A-Changing….Fast
By KIM BELLARD
If you have been following my Twitter – oops, I mean “X” – feed lately, you may have noticed that I’ve been emphasizing The Coming Wave, the new book from Mustafa Suleyman (with Michael Bhaskar). If you have not yet read it, or at least ordered it, I urge you to do so, because, frankly, our lives are not going to be the same, at all. And we’re woefully unprepared.
One thing I especially appreciated is that, although he made his reputation in artificial intelligence, Mr. Suleyman doesn’t only focus on AI. He also discusses synthetic biology, quantum computing, robotics, and new energy technologies as ones that stand to radically change our lives. What they have in common is that they have hugely asymmetric impacts, they display hyper-evolution, they are often omni-use, and they increasingly demonstrate autonomy.
In other words, these technologies can do things we didn’t know they could do, have impacts we didn’t expect (and may not want), and may decide what to do on their own.
To build an AI, for the near future one needs a significant amount of computing power, using specialized chips and a large amount of data, but with synthetic biology, the technology is getting to the point where someone can set up a lab in their garage and experiment away. AI can spread rapidly, but it needs a connected device; engineered organisms can get anywhere there is air or water.
“A pandemic virus synthesized anywhere will spread everywhere,” MIT”s Kevin Esvelt told Axios.
I’ve been fascinated with synthetic biology for some time now, and yet I still think we’re not paying enough attention. “For me, the most exciting thing about synthetic biology is finding or seeing unique ways that living organisms can solve a problem,” David Riglar, Sir Henry Dale research fellow at Imperial College London, told The Scientist. “This offers us opportunities to do things that would otherwise be impossible with non-living alternatives.”
Jim Collins, Termeer professor of medical engineering and science at Massachusetts Institute of Technology (MIT), added: “By approaching biology as an engineering discipline, we are now beginning to create programmable medicines and diagnostic tools with the ability to sense and dynamically respond to information in our bodies.”
For example, researchers just reported on a smart pill — the size of a blueberry! — that can be used to automatically detect key biological molecules in the gut that suggest problems, and wirelessly transmit the information in real time.
Continue reading…Shiv Rao, CEO demos Abridge
Abridge has been trying to document the clinical encounter automatically since 2018. There’s been quit a lot of fuss about them in recent weeks. They announced becoming the first “Pal” on the Epic “Partners& Pals” program, and also that their AI based encounter capture technology was now being used at several hospitals. And they showed up in a NY Times article about tech being used for clinical documentation. But of course they’re not the only company trying to turn the messy speech in a clinician/patient encounter into a buttoned-up clinical note. Suki, Augmedix & Robin all come to mind, while the elephant is Nuance, which has itself been swallowed by the whale that is Microsoft.
But having used their consumer version a few years back and been a little disappointed, I wanted to see what all the fuss was about. CEO Shiv Rao was a real sport and took me through a clinical example with him as the doc and me as a (slightly) fictionalized patient. He also patiently explained where the company was coming from and what their road map was. But they are all in on AI–no off shore typists trying to correct in close to real time here.
And you’ll for sure want to see the demo. (If you want to skip the chat it’s about 8.00 to 16.50). And I think you’ll be very impressed indeed. I know I was. I can’t imagine a doctor not wanting this, and I suspect those armies of scribes will soon be able to go back to real work! — Matthew Holt
Smells like AI Spirit
By KIM BELLARD
There are so many exciting developments in artificial intelligence (AI) these days that one almost becomes numb to them. Then along comes something that makes me think, hmm, I didn’t see that coming.
For example, AI can now smell.
Strictly speaking, that’s not quite true, at least not in the way humans and other creatures smell. There’s no olfactory organ, like our nose or a snake’s tongue. What AI has been trained to do is to look at a molecular structure and predict what it would smell like.
If you’re wondering (as I certainly did when I heard AI could smell), AI has also started to crack taste as well, with food and beverage companies already using AI to help develop new flavors, among other things. AI can even reportedly “taste wine” with 95% accuracy. It seems human senses really aren’t as human-only as we’d thought.
The new research comes from the Monell Chemical Senses Center and Osmo, a Google spin-off. It’s a logical pairing since Monell’s mission is “to improve health and well-being by advancing the scientific understanding of taste, smell, and related senses,” and Osmo seeks to give “computers a sense of smell.” More importantly, Osmo’s goal in doing that is: “Digitizing smell to give everyone a goal at a better life.”
Osmo CEO Alex Wiltschko, PhD says: “Computers have been able to digitize vision and hearing, but not smell – our deepest and oldest sense.” It’s easy to understand how vision and hearing can be translated into electrical and, ultimately, digital signals; we’ve been doing that for some time. Smell (and taste) seem somehow different; they seem chemical, not electrical, much less digital. But the Osmo team believes: “In this new era, computers will generate smells like we generate images and sounds today.”
I’m not sure I can yet imagine what that would be like.
The research team used an industry dataset of 5,000 known odorants, and matched molecular structures to perceived scents, creating what Osmo calls the Principle Odor Map (POM). This model was then used to train the AI. Once trained, the AI outperformed humans in identifying new odors.
The model depends on the correlation between the molecules and the smells perceived by the study’s panelists, who were trained to recognize 55 odors. “Our confidence in this model can only be as good as our confidence in the data we used to test it,” said co-first author Emily Mayhew, PhD. Senior co-author Joel Mainland, PhD. admitted: “The tricky thing about talking about how the model is doing is we have no objective truth.”
The study resulted in a different way to think about smell. The Montell Center says:
The team surmises that the model map may be organized based on metabolism, which would be a fundamental shift in how scientists think about odors. In other words, odors that are close to each other on the map, or perceptually similar, are also more likely to be metabolically related. Sensory scientists currently organize molecules the way a chemist would, for example, asking does it have an ester or an aromatic ring?
“Our brains don’t organize odors in this way,” said Dr. Mainland. “Instead, this map suggests that our brains may organize odors according to the nutrients from which they derive.”
“This paper is a milestone in predicting scent from chemical structure of odorants,” Michael Schmuker, a professor of neural computation at the University of Hertfordshire who was not involved in the study, told IEEE Spectrum. It might, he says, lead to possibilities like sharing smells over the Internet.
Think about that.
“We hope this map will be useful to researchers in chemistry, olfactory neuroscience, and psychophysics as a new tool for investigating the nature of olfactory sensation,” said Dr. Mainland. He further noted: “The most surprising result, however, is that the model succeeded at olfactory tasks it was not trained to do. The eye-opener was that we never trained it to learn odor strength, but it could nonetheless make accurate predictions.”
Next up on the team’s agenda is to see if the AI can learn to recognize mixtures of odors, which exponentially increases the number of resulting smells. Osmo also wants to see if AI can predict smells from chemical sensor readings, rather than from molecular structures that have already been digitized. And, “can we digitize a scent in one place and time, and then faithfully replicate it in another?”
That’s a very ambitious agenda.
Dr. Wiltschko claims: “Our model performs over 3x better than the standard scent ingredient discovery process used by major fragrance houses, and is fully automated.” One can imagine how this would be useful to those houses. Osmo wants to work with the fragrance industry to create safer products: “If we can make the fragrances we use every day safer and more potent (so we use less of them), we’ll help the health of everyone, and also the environment.”
When I first read about the study, I immediately thought of how dogs can detect cancers by smell, and how exciting it might be if AI could improve on that. Frankly, I’m not much interesting in designing better fragrances; if we’re going to spend money on training AI to recognize molecules, I’d rather it be spent on designing new drugs than new fragrances.
Fortunately, Osmo has much the same idea. Dr. Wiltschko writes:
If we can build on our insights to develop systems capable of replicating what our nose, or what a dog’s nose can do (smell diseases!), we can spot disease early, prevent food waste, capture powerful memories, and more. If computers could do these kinds of things, people would live longer lives – full stop. Digitizing scent could catalyze the transformation of scent from something people see as ephemeral to enduring.
Now, that’s the kind of innovation that I’m hoping for.
Skeptics will say, well, AI isn’t really smelling anything, it’s just acting as though it does. E.g., there’s no perception, just prediction. One would make the same argument about AI taste, or vision, or hearing, not to mention thinking itself. But at some point, as the saying goes, if it looks like a duck, swims like a duck, and quacks like a duck, it’s probably a duck. At some point in the not-so-distant future, AI is going to have senses similar to and perhaps much better than our own.
As Dr. Wilkschko hopes: “If computers could do these kinds of things, people would live longer lives – full stop.”
Kim is a former emarketing exec at a major Blues plan, editor of the late & lamented Tincture.io, and now regular THCB contributor.
The Next Pandemic May Be an AI one
By KIM BELLARD
Since the early days of the pandemic, conspiracy theorists have charged that COVID was a manufactured bioweapon, either deliberately leaked or the result of an inadvertent lab leak. There’s been no evidence to support these speculations, but, alas, that is not to say that such bioweapons aren’t truly an existential threat. And artificial intelligence (AI) may make the threat even worse.
Last week the Department of Defense issued its first ever Biodefense Posture Review. It “recognizes that expanding biological threats, enabled by advances in life sciences and biotechnology, are among the many growing threats to national security that the U.S. military must address. It goes on to note: “it is a vital interest of the United States to manage the risk of biological incidents, whether naturally occurring, accidental, or deliberate.”
“We face an unprecedented number of complex biological threats,” said Deborah Rosenblum, Assistant Secretary of Defense for Nuclear, Chemical, and Biological Defense Programs. “This review outlines significant reforms and lays the foundation for a resilient total force that deters the use of bioweapons, rapidly responds to natural outbreaks, and minimizes the global risk of laboratory accidents.”
And you were worried we had to depend on the CDC and the NIH, especially now that Dr. Fauci is gone. Never fear: the DoD is on the case.
A key recommendation is establishment of – big surprise – a new coordinating body, the Biodefense Council. “The Biodefense Posture Review and the Biodefense Council will further enable the Department to deter biological weapons threats and, if needed, to operate in contaminated environments,” said John Plumb, Assistant Secretary of Defense for Space Policy. He adds, “As biological threats become more common and more consequential, the BPR’s reforms will advance our efforts not only to support the Joint Force, but also to strengthen collaboration with allies and partners.”
Which is scarier: that DoD is planning to operate in “contaminated environments,” or that it expects these threats will become “more common and more consequential.” Welcome to the 21st century.
Continue reading…Can AI Part The Red Sea?
BY MIKE MAGEE
A few weeks ago New York Times columnist Tom Friedman wrote, “We Are Opening The Lid On Two Giant Pandoras Boxes.” He was referring to 1) artificial Intelligence (AI) which most agree has the potential to go horribly wrong unless carefully regulated, and 2) global warming leading to water mediated flooding, drought, and vast human and planetary destruction.
Friedman argues that we must accept the risk of pursuing one (rapid fire progress in AI) to potentially uncover a solution to the other. But positioning science as savior quite misses the point that it is human behavior (a combination of greed and willful ignorance), rather than lack of scientific acumen, that has placed our planet and her inhabitants at risk.
The short and long term effects of fossil fuels and carbonization of our environment were well understood before Al Gore took “An Inconvenient Truth” on the road in 2006. So were the confounding factors including population growth, urbanization, and surface water degradation.
When I first published “Healthy Waters,” the global population was 6.5 billion with 49% urban, mostly situated on coastal plains. It is now 8 billion with 57% urban and slated to reach 8.5 billion by 2030 with 63% urban. 552 cities around the globe now contain populations exceeding 1 million citizens.
Under ideal circumstances, this urban migration could serve our human populations with jobs, clean air and water, transportation, housing and education, health care, safety and security. Without investment however, this could be a death trap.
Continue reading…