The AI Product Going Viral With Doctors: OpenEvidence, with CEO Daniel Nadler

[00:00] One of the things we hear so frequently from doctors about open evidence is, [00:06] You know, I used it. [00:07] to look up this thing, [00:09] for a patient case that is maybe a patient case that I would have seen one or two times in my career. [00:16] And then the same doctors are saying that about a different patient case. [00:20] and then about a different patient case, and then about a different patient case. And then you realize just how long the tale of this thing is, where it's like, well, if the majority of your uses of open evidence are patient cases that you would see once or twice in your career, then that really captures what the thing is doing. [00:39] Thank you. [00:54] One of the questions on everybody's mind as it relates to AI is, [01:01] Will this actually be good for humanity? [01:04] One of the use cases, [01:06] where AI is inarguably good. [01:10] His medicine. [01:12] Thank you. [01:13] We have Daniel Nadler. [01:15] co-founder of Open Evidence. [01:16] on the show today. [01:18] Thank you. [01:18] Open Evidence is trained on peer-reviewed medical literature. [01:24] to provide an AI co-pilot [01:26] that helps doctors make better decisions at the point of care.

[01:31] This is inarguably. [01:33] Good for humanity. [01:34] Thank you. [01:35] It doesn't take crazy assumptions. [01:37] to believe that open evidence will save a million lives over the next decade. [01:42] Today we'll hear from Daniel. [01:44] on how they've built the product, [01:46] What's different versus some of the other application layer AI products out there [01:51] and some real-life examples. [01:53] of how it's being used in the field. [01:56] to the benefit of everybody. [01:58] We hope you enjoy. [01:59] Daniel, welcome to Training Data. Thanks for coming on the show. Thanks, Pat, for having me. [02:05] All right. How many doctors? [02:08] Thank you. [02:09] We'll use open evidence today. [02:12] Today, probably over 100,000 physicians in the United States and more globally. [02:17] And what would that number have been about a year ago? [02:21] a thousand fewer than zero. You know, look, most people aren't aware of this, but there's only about a million doctors in the United States serving a population of over 340 million people, which is itself an issue that we'll probably talk about later on. But there's only a population about a million doctors today, maybe... [02:42] A hundred thousand of them are going to use open evidence. [02:46] on a monthly basis, about three, 400,000 monthly active users touch our system, including over 200,000 that log in and ask questions. So, um, [02:59] you know, you're talking about [03:01] Thank you.

[03:02] 10, 15, 20%. [03:04] maybe even 25% of doctors in the United States that are using open evidence in some form or another. And we're not healthcare investors. We're technology investors here at Sequoia. But my understanding is that it's not normal. [03:18] for a hundred thousand doctors, [03:20] Thank you. [03:21] to be using something overnight. My understanding is that in healthcare, it normally takes a lot longer to get to that sort of scale. So what did you guys do right? Well, that's why we get along so well, because you're not healthcare investors, and our approach has not been a healthcare approach. What we got right is we realized that doctors are people too. [03:40] doctors or consumers. In fact, everyone's a consumer. I think that's what you get right in your investment strategy, which is you don't sort of think about [03:50] um, [03:51] Consumer Internet applications is one category. And then, you know, a bunch of stuff over here as its own kind of weird, quirky, opaque, siloed industry categories over there. You think about everything in. [04:05] terms of consumer, consumer and growth curves. And that's exactly how we thought of it. You know, obviously, if you try to go top down, so everyone says, you know, it's such a refrain, you know, healthcare is impossible to break into. [04:18] Healthcare is so hard. Don't start healthcare. And I think the evidence generally supports that. Of course, because they're all trying to do the same. They're all trying to bang their head against the wall in the exact same way. They're all trying to go to the top of some integrated delivery network, which is like a large network of hospital systems, score a meeting with the CMIO or the CTO or the, you know, all these acronyms.

[04:48] calendar. Meeting one will be great. They'll high five each other. They'll be like, that was a great meeting. We got great feedback. What's the follow up? Well, they're going to schedule a follow up meeting, which will probably be with a responsible AI committee. That will take three months after the first meeting. Then you'll present to the responsible AI committee, you know, at that hospital. Along the way, the committee members will have changed their strategy and responsible AI will have changed. Maybe the presidential administration will have changed. And now JD Vance is saying, actually, you have to change your approach to responsible AI. So that gets [05:18] you're a year into it before you're, you know, in meeting three or meeting four. And by the way, no doctors. [05:23] They're... [05:24] along the way or getting the benefit of using the application. I had a lot of experience, you know, this wasn't my first rodeo. I had sold, um, [05:32] very successful AI company before starting Open Evidence, Kensho. And so I was very familiar with how corporate America works and how large organizations work. It's not specific to the healthcare system. It's just called large organizations. And I was very familiar with that. I had pattern recognition to that. And so I realized that that wasn't really a viable path forward for us, especially this is my second company was very mission driven. It was very [06:02] But it would not have been... [06:04] much sense of accomplishment for me to have nominally started a second company that was mission-driven or impact-driven in healthcare, but then have no doctors using it because we're waiting for meeting number six or seven or eight with the hospital system. So long story short, we just took a radically different approach. Doctors are people too. Doctors are consumers.

[06:25] too. And if you make something awesome, that is... [06:30] Life-changing and game-changing and profession-changing for knowledge workers. And it's really good enough. And you put it out on the App Store. It sounds 101, but it really works, people. You make something awesome. [06:42] You put it out on the app store for free. And it turns out that without fancy marketing campaigns or large marketing budgets or anything like that, all of our growth is word of mouth. Doctor to doctor to doctor to doctor. [06:57] people will start using it and people will discover it and then they'll start using it. And when they start using it and if it's really awesome, they'll tell other people about it. And then you get just sort of the network effects that, you know, you got with Tesla early on. Tesla early on famously spent, you know, almost no money in marketing. They didn't, you know, as I understood, car commercials were kind of one of the largest category of advertising. It was it was taken as dogma that if you wanted to have even a remotely successful automobile, [07:26] You needed to spend enormous sums of money on advertising those cars. And Tesla early on said, we're just going to make a product that's so awesome that people will tell other people about it. Someone will drive it. They'll be like, oh, my God, this is so much better than other cars and tell other people about it. And that sort of word of mouth network effect that Tesla had happened with open evidence with doctors where. [07:50] Doctors downloaded from the app store, as I said, a year ago would have been, I don't know, somewhere between zero and a thousand doctors using it. Today, it's hundreds of thousands. It's, you know, 10, 15, 20, maybe 25 percent of active physicians in the United States. It really the denominator.

[08:07] It depends on how you calculate it because there are more physicians that are... [08:11] have a medical license that are necessarily active at any one time. But, you know, it's as it's as little as 10 percent and as high as 25 percent of active physicians in the United States use open evidence today. And all of that is just this sort of Tesla logic of like make an awesome car. It'll spread through word of mouth. And I think it's intuitive to people what it means to have an awesome car. It's probably not intuitive to people what it means to have an awesome app for doctors. Yeah. So what are doctors actually doing in this app? Why do they like it so much? [08:41] Thank you. [08:43] I think something is awesome if first and foremost, it solves a real need and a real pain point, right? So much of technology is a solution in search of a problem. It's important to be able to word problems that are real and have a solution that addresses a real problem. [08:58] you got to begin from, well, what's hard about being a doctor. Um, [09:02] One of the hardest things about being a doctor besides the hours, having to go through medical school and all the rest, the fact that they're stretched too thin and there's too few of them for the population, is that they're expected to keep up with a fire hose of medical information. So this is really not appreciated by people who are not. [09:17] Doctors. [09:18] but [09:20] There's two new medical papers published every minute, 24 hours per day. Two new medical papers published every minute, 24 hours per day. [09:28] per day, seven days a week. There was a... [09:33] study done in publishing nature that said that medical knowledge doubles every 73 days. That's probably that methodology was probably

[09:42] a little aggressive. We did our own internal study to open evidence of the rate of doubling of medical knowledge. We came up with a much more conservative number, but that's still five years. Our conservative number is medical knowledge doubles every five years. There's a lot of methodology in how you think about counting [09:56] you know, all citations, if it's all citations, yeah, it doubles every 73 days, but not all citations in medicine are equal. Even if you really just count what you should count, which is [10:06] the stuff that doctors really need to know. Like, [10:09] top tier journals, [10:12] Um... [10:13] that have the highest impact factors [10:15] let's say the top third of journals, something like that, [10:18] even [10:19] with that very conservative methodology, you're talking about medical knowledge doubling every five years. So if you think about the math of that for a second, so in 1950, medical knowledge doubles every 50 years. Today, it doubles. [10:31] every five years. What that means is if you graduate medical school in 1950, [10:36] The half-life of what you've learned in medical school, meaning the time it takes for half of what you learn in medical school to kind of be out of date. And we're not talking about anatomy or, you know, anatomy is cellular biology. That stuff doesn't change or doesn't change that quickly. [10:53] the rest of it actually does change and so in 1950 the growth of medical knowledge meaning new treatments that they need to be aware of was every 50 years which means the half-life of what they learned in medical school nicely overlapped with the length of their career so [11:07] By the time they retired, maybe half of what they learned in medical school in terms of the efficacy of new treatments and new treatments that were available was kind of out of date. But they were retiring. So that's kind of OK. Right. And they tried to keep up along the way. And it was easier to keep up along the way because it was so much slower. Today, if you think about that same framework.

[11:29] by the time they're [11:32] like, [11:32] depending on their specialty, going through their residency and fellowship. [11:36] half of what they learned... [11:39] in medical school is now out of date. [11:41] in terms of new treatments, [11:43] the efficacy of those treatments and someone. So, [11:48] It's just... [11:49] It's impossible for doctors to keep up with that because medical school, which is what most people are not doctors assume, is the information transmission mechanism for medical knowledge. [12:00] only sustains a doctor for a couple of years these days in terms of the half-life of their knowledge. You have a patient coming... [12:08] to the dermatologist who has psoriasis, okay, maybe say, fine, just... [12:13] read up on the new classes of [12:15] biologics and pick one based on efficacy and safety. And in this example, you see that [12:23] the specialization of medicine becomes very challenging because the dermatologist maybe is keeping up with the dermatology journals and all the new biologics for psoriasis that are published in the dermatology journals. But MS is a neurology condition. And it's ludicrous to expect the dermatologist to also read every single page of every single neurology journal, let alone the [12:53] So, [12:55] The dermatologist in that situation, in that scenario, is in a real pickle.

[12:59] because they don't want to make the MS worse. They don't want to just send the patient away and say, hey, everything's too risky, so we're not going to treat your psoriasis because that's a quality of life issue for the patient. And they need to sort of figure out [13:12] What is the latest evidence, hence open evidence, what is the latest evidence? [13:18] on the efficacy of, yes, IL-17 inhibitors and IL-23 inhibitors, but specifically with a lens to what is the efficacy and safety of those inhibitors for patients who also have the [13:33] That [13:33] information hunting gathering exercise is... [13:38] In a traditional way, [13:39] you know, pre-open evidence is just very painful. The traditional way of doing that, you would, you'd go on Google, try to Google this, you'd go on PubMed. None of those searches work particularly well. They'll sort of give you the titles of the articles. But this is such a specific question. This is a very specific question. This is not like a generic question. [14:01] article titled, like, what is the efficacy of IL-17 inhibitors? This is a very specific question. What is the safety of IL-17 inhibitors versus IL-23 inhibitors for a patient with both psoriasis and MS? And that was a real need to come back to your question, what makes something awesome for doctors? Not just this one specific case, but [14:20] As you can imagine, [14:22] for every... [14:24] Um... [14:25] Example you can give like this of, you know, a comorbidity, psoriasis, MS, MS,

[14:30] seeing a dermatologist, the surface area of medicine is so enormous that you have millions and millions and millions. [14:37] of. [14:38] cases like this, you know, engineers that are listening to this can immediately understand this. Everything is an edge case. Everything is a corner case. Right. So from an engineering perspective, the way to think about medicine is, you know, the surface area is it's not. [14:51] truly infinite, but it's for all intents and purposes, enormous. And everything is an edge case and everything is a corner case. And you're trying to always look up the edge case or the corner case. That's the experience of being a doctor put in engineering terms. [15:04] And so if you can solve, [15:06] The experience of being a doctor framed in engineering terms of everything is an edge case. Everything is a corner case. Go find solve the lookup for that edge case in that corner case, meaning go find the reference. [15:18] somewhere in a medical journal that is a peer-reviewed, [15:22] top-tier medical journal that answers the question of the comparative safety of IL-17s versus IL-23s in a patient with [15:30] psoriasis and MS, which is never going to be in the title, which is what PubMed or Google could find. It's always going to be buried, you know, on page five or six or seven of that 30 page medical journal article. Then you have made the experience of being a doctor. [15:48] that much better. You have made the lives of doctors that much better. And most importantly, you've improved [15:54] the life of [15:56] the patients that they're treating because you, [15:59] Then you've prevented a scenario where the MS is getting worse because the doctor didn't know, hey, you know, IL-17s are very promising generally for psoriasis. But if a patient has MS, IL-23s are actually a lot safer, right?

[16:14] If the doctor... [16:15] Didn't know that, which there's no reason for them to know because the average, you know, given the average age of a doctor, neither of those two things existed when they went to medical school. They couldn't have. It's not even like a study question. They could not have learned that in medical school. IL-23 inhibitors came out in 2017, 2018, 2019. There's no way, even if doctors my age. [16:34] And I'd be a young looking doctor. Most doctors you see... [16:38] you know, are older than I am. And even if a doctor were my age, I am old enough that were I a doctor, I would not have learned that in medical school. So there's no way a doctor can learn that in medical school. They would need to sort of [16:51] keep up with post-medical school. And because it's an edge case or corner case, and because for every one example like that example, there's 10,000 other examples that they would also need to stay on top of, they probably would have had a hard time keeping up with that. [17:04] data point pre-open evidence, and that would have resulted in a worse outcome for patients. And one of the things we hear so frequently from doctors about open evidence is, [17:16] um. [17:17] You know, I used it. [17:18] to look up this thing, [17:20] for a patient case that is maybe a patient case that I would have seen one or two times in my career. [17:27] And then the same doctors are saying that about a different patient case. [17:31] And then about a different patient case. And then about a different patient case. And then you realize just how long the tail of this thing is where it's like, [17:39] Well, [17:40] If the majority of your uses of open evidence... [17:43] are patient cases that you would see once or twice in your career, then that really captures what the thing is doing. It's essentially running...

[17:53] search and discovery and knowledge retrieval on... [17:58] a tail that is not nothing is infinitely long, but, but it's so long that it for all intents and purposes to a, to a, to a wet human brain might as well be infinitely long. Yeah. Yeah. The, you know, the data on the rate at which medical knowledge is increasing, it's a very, it's a very positive data point, right? Like it's great that medical research and medical knowledge is increasing so quickly. It's like this keg being filled with potential energy that hasn't converted into kinetic energy because we have this choke point, which is a human's ability to ingest and make sense of all this information. So it, [18:28] It makes sense that now that AI is here, AI is great at looking over enormous amounts of text and doing reasoning across enormous amounts of text. It makes sense that AI is a little bit of an unlock to sort of convert that into kinetic energy with the system-level view. The question, we talked a bit about... [18:45] some of this evidence that's going into the system. Decompose the name of the company real quick, Open Evidence. Why is being open important? And what exactly is all the evidence that's going into the system? Sure. So the evidence is peer-reviewed medical literature, and it's most important to say what it's not. One of the reasons you got so many egg-on-face situations from large, [19:12] Uh, [19:13] tech companies that put out [19:15] AI systems in the area of medicine. You got these sort of egg on face situations that I won't say specific examples, but [19:21] I think we all know what they are, is because they were doing retrieval across the public Internet, which means they're doing retrieval across the.

[19:29] health blogs. [19:31] health blogs on the public internet. They might have been doing retrieval at the time on Twitter before... [19:37] Elon caught off access to that. There's a lot of stuff on Twitter that you wouldn't want to be the basis for. [19:44] Um, [19:45] for a doctor's decision. But even if you just take the health blog thing, it's amazing how many... [19:52] health blog writers there are on the internet. I only discovered that when I sort of started working on this problem. And most people assume that the people writing health blogs [20:00] Our doctors really have some connection to medicine. That's actually not the case. [20:05] These are not bad people. [20:06] Uh, they're really well-meaning people, but what you'll find is a lot of these people are only part-time health blog writers and they're also part-time travel writers. Hmm. [20:15] or they're part-time cooking recipe writers. They're basically, you know, they're sort of journalists, bloggers, where their core skill set is writing. They're very good at writing. They don't have any domain expertise. [20:28] in medicine. They don't know any more about medicine necessarily than they know about planning an itinerary for a trip to Mexico. And... [20:38] That's what goes in [20:41] to the training data. This thing's called training data. And then we're shocked [20:45] when in the early days of large language models, [20:49] They said all sorts of crazy things. [20:51] Well, they didn't say crazy things. They regurgitated what was in the training data. And those things didn't intend to be crazy, but they were just not written by experts. So...

[21:03] All of that's to say, you know, [21:05] Where open evidence really... [21:07] right in its name and then in the early days, took a hard turn in the other direction from that. [21:15] All the models that we're going to train do not have a connection to the Internet. [21:19] They literally are not connected to the public internet. You don't even have to go so far as like what's in, what's out. There's no connection to the public internet. None of that stuff goes into... [21:28] the open evidence models that we train. [21:31] What does go into the open evidence models that we train is the New England Journal of Medicine, which we have achieved through a strategic partnership. [21:37] with the New England Journal of Medicine. Stay worried about that for a minute, because my understanding is that New England Journal of Medicine doesn't just give all of its research to everybody for free to go train on. [21:47] They don't, to the best of my knowledge, we're the only AI company that they've done this with. And without getting into the specifics, we're not the only AI company that's asked. They've said no many times. [22:00] Why do they seemingly trust open evidence when they don't trust other folks? [22:07] What makes you particularly appealing to them? [22:09] Well, the... [22:11] Looking into the exact play by play, what happened was a number of other well-known AI companies showed up at their door and said, can we train on the England Journal of Medicine? And the England Journal of Medicine said no. [22:23] I won't even get to the reasons of why they said no, and I'm not them, so I don't speak on the behalf. But they said no. In our case, we didn't show up at their door. A number of the very senior people on the editorial board in the New England Journal of Medicine were power users of open evidence, and they wanted their content to show up in the thing that they were using. So it's beautiful, right?

[22:53] importance of. [22:54] their brand and the sanctity of their brand and you know they're [22:59] There. [23:00] They're the pinnacle. They're the apex medical journal and the Massachusetts medical and they're nonprofit. They're not commercially motivated. There's no amount of money you could throw at them. That's going to make them make a perfectly mercenary decision. And in fact, without getting the specifics of it, [23:14] some of these really well-funded AI companies threw enormous amounts of money at them. And they said, no, if they're a private company, they probably would have said yes, but they're a nonprofit. So they said no, because the Massachusetts Medical Society, which is a nonprofit organization, cared more about the sanctity and the pristineness of their mission as a nonprofit than they did about just trying to score some sort of quick [23:38] commercial contract. In the case of Open Evidence, again, it was beautiful. Very senior people there were users. And then this sort of circles back to what we talked about right at the start, which is had we waited, had we taken a top-down approach, had we taken an enterprise SaaS approach, [23:58] and been in waiting mode for meeting number 17 with the hospital system and no one was using it. Well, if no one was using it, [24:05] That would include no one at the New England Journal of Medicine using it, which would have meant that they wouldn't have fallen in love with it, which meant that we would have never had a... [24:15] opportunity to strike a content partnership with them that would have been, you know, that in turn made the whole thing that much better and more awesome to the people using it. So you get into vicious cycles versus virtuous cycles. In our case, the whole thing was a virtuous cycle. We put it out there.

[24:30] people downloaded it for free. Some of those people included [24:34] very senior people at the New England Journal of Medicine. They started using it. They fell in love with it. They reached out to us. We did this deal. And now the thing... [24:42] is 10,000 times better because... [24:44] you know, is trained on the... [24:46] full tax of New England Journal of Medicine, which no AI today in the market, I can tell you with certainty, no AI today in the market is trained on the full tax of New England Journal of Medicine other than open evidence. [24:57] So we talked about the evidence part. Let's talk about the open part a little bit. What is... [25:01] What does the open piece of open evidence mean and why is that part important? [25:05] Open meant a lot of things to me in the early days. One of the things that it meant was capturing that go-to-market strategy that we talked about, which is for me, open was almost a reminder to myself that this was not, [25:18] an enterprise SaaS company. You know, my first company was an enterprise SaaS company. Those can be great businesses. I don't need to tell you you've had phenomenal success with enterprise SaaS companies. They can be great businesses. [25:30] But... [25:31] For my second company, I didn't want to just have a mission-driven, impact-driven company. I also wanted to have a company that was different from... [25:41] my first company in every respect because I don't like repeating myself. Um, [25:45] Specifically, I want it to be sort of direct to consumer, in our case, direct to prosumer. So the open for me sort of symbolize that, that we would go directly to doctors, that we wouldn't go to their gatekeepers. We wouldn't allow people to be gatekeepers to doctors. We would go directly to doctors. We'd appeal directly to doctors. We'd appeal directly to the pain points that they experience on a daily basis, which is that they're overstretched or overworked. They're not enough of them. They're stretched far too thin in terms of the number of patients that they need to see

[26:15] forced to drink from a medical information fire hose. And we were going to make that better. And we're going to help tame that medical information fire hose. And we're going to make that appeal directly to doctors. [26:24] as consumers and as people specifically. And that was a big part of what open meant. You know, there's enormous inequality [26:33] in the healthcare system in the United States. Um, [26:36] as there is in everything in the West. And they're the haves and they're the have-nots. And the best... [26:44] hospital systems in the United States, which have enormous endowments and unlimited funding, [26:50] can afford to buy not just like one tool or two tools or three tools. They can afford to buy every tool in the category and try them all out. And they can afford to have like, [27:00] doctors not really use most of them and that's okay because you know, [27:04] If Doge or Elon went and did an audit of the... [27:09] sass spend of some of these really well endowed hospitals he would have a field day because what you'd find is they're buying everything and they're using almost nothing yeah um [27:18] And, [27:19] That's happening over here, while over here you have doctors in rural parts of the country or urban parts of the country that just are socioeconomically disadvantaged, or you have doctors that are in private practice or in practices of 10 or fewer doctors. Most people don't realize about doctors. A lot of doctors are small business owners. They don't work for these enormous hospital systems with a lot of money. A lot of doctors... [27:43] are self-proprietors. They're small business owners. They have a practice. It's kind of almost like the 1950s, but it persists. They have a practice. They might have one or two people helping them in an administrative capacity or a secretary or something like that, but they're the principal and they have to deal with all the administrative stuff, plus C patients, plus, plus, plus, plus. And they don't have these enormous technology budgets. They certainly don't

[28:13] like some hospitals do, then they can't afford to go pay $10,000 a month. [28:17] for a enterprise SaaS subscription to some software product. So all of that is what Open meant. We got a letter from a doctor in Albany, Georgia, [28:26] who said he's the director of a cancer center in Georgia. And he's in community practice as a community oncology practice. And that open evidence has become a lifeline to his daily practice in his cancer center and has been a game changer for patients and treating his cancer patients. And like most people, I didn't know much about [28:50] Albany, Georgia. So I looked up Albany, Georgia and very quickly on Wikipedia, I discovered that Albany, Georgia is in southwestern Georgia. It's 75% African-American. It has a median household income of $43,000 a year. And I started to piece together. [29:06] the situation. You know, there's doctors probably... [29:09] The only oncologist. [29:12] in a 50 mile radius, maybe there's a second one and they're serving on, you know, [29:17] an enormous geography of fairly poor people. And there's no way that, [29:25] that this doctor has the resources to pay 10 or $20,000. [29:30] SaaS subscription software rates for for anything. And that to me is what open means. It means the doctor in Fairbanks, Alaska, who wrote us a letter saying that she practices in, again, a community setting in Fairbanks, Alaska, very limited access to subspecialists and open evidence has been open.

[29:53] a game changer for her in... [29:56] allowing her to sort of access subspecialty level medical knowledge without direct access to human subspecialists in Fairbanks, Alaska. [30:04] Again, if you look up that situation or just even think through that situation, she's not paying, you know, she's in a community practice. She doesn't work for a hospital that can afford this kind of stuff. So that's what open means. It's every doctor in the country. We're really proud that. [30:19] were used not just at Mayo Clinic in Cleveland. We love the Mayo Clinic. We were partly incubated at the Mayo Clinic. We love these sort of [30:27] Elite hospital settings. We have a lot of users at these elite hospital settings that also use it for free. [30:34] But we're not just used at the Mayo Clinic. [30:36] We're not just used at the Cleveland Clinic. We're used across the country. We're used in the middle of the country. We're used at Walter Reed, where our nation's warriors and veterans are treated, without the government having to go through a three-year procurement process. [30:51] process to decide whether they want to use open evidence. You know, that's another example. [30:55] So one of the biggest health systems is the VA. [30:58] To me, that's one of the most important health systems because it treats our warriors and our veterans. For the VA to decide to do anything is probably a three-year exercise. And we're open evidence, not open. [31:10] to answer your question, we would probably still be in year 1.5 of three to four years of a government procurement process to decide whether doctors in the VA could treat their... [31:20] patients who are warriors and veterans with the benefit of open evidence and thankfully we didn't go that route and

[31:27] We're getting letters from from doctors in the VA talking about using open evidence to make a treatment decision at the point of care for a wounded warrior. You know, that's this energizes me waking up every day. So that's what open means. [31:39] Um, [31:40] Okay, so you... [31:42] You guys, you've built something of a killer app for medicine, and it's working. It's working really well. [31:50] And we have a lot of people... [31:52] typically who listen to the show who are themselves trying to build [31:55] killer apps of some sort for AI. So I'm curious using AI. Um, [32:01] So I'm curious, how did you build it? Like what, you know, is this a wrapper on top of GPT-3 or GPT-4? Like what is the, what's going on under the hood? How'd you build it? [32:11] So I think what... [32:13] I'm going to sort of have two parts to what I say. I'm going to sort of talk about what we did and then talk about what is applicable for [32:21] a lot of people listening to us. Now, I'm guessing a lot of people listening to us are building applications that... [32:27] don't necessarily have the same requirements that medicine has. So I do want to address that. In the case of medicine, the way we attack the problem is by bringing together a team of PhD level scientists who are working in the field. My co-founder, Zachary Ziegler, who's a brilliant computer scientist from Harvard, studied with Alexander Rush in his natural language processing

[32:57] before ChatGPT even came out. [33:00] Evan Hernandez comes from Jacob Andreas' lab at MIT. So I could go on and on. Eric Lehman from MIT as well. I mean, we put together a team of, [33:10] sort of elite scientists who are working at the frontier of language models at the top. [33:15] you know, two of the top three, maybe labs, if not two of the top two labs at the time in the country, in the world, actually. And we needed to do that because... [33:26] we're trying to solve medicine and we're trying to solve the application language models in medicine and that, [33:32] was a very high standard and a very high bar and it hadn't been solved. And, and what the very large consumer companies were putting out, um, [33:41] was creating all sorts of embarrassing moments in medicine for those companies at the time. Sort of recent enough that we probably all remember this. And so we needed sort of that level of almost the intersection of academia and [33:56] And, [33:57] engineering to go after this problem. And we needed to, in our case, produce original research and original knowledge. So we attacked the problem in a different way. Everyone was trying to, at the time, focus on us, you know, scaling these language models larger and larger and larger and larger. And we were very, very early. You know, now this is sort of consensus with DeepSeek and all this stuff. But rewind, this is 2022. We were very early to the insight of, [34:26] that smaller, highly specialized models over-trained on in-domain data would outperform much larger models on those in-domain tasks. They were very rigid. They wouldn't write you a poem.

[34:36] Um, they'd fall over very quickly the second you go outside the domain, but in the domain, they were beautiful. They outperformed. And, uh, we published our work. We were, we approached this very academically. My background is, you know, academic as well. I did my PhD at Harvard and, um, we were all academics by background. Um, and we published our work, uh, in this paper, do we still need clinical language models? Uh, which, uh, was awarded the best paper and machine learning, uh, in 2023 at the, at the [35:05] at the leading conference in machine learning and healthcare, and attracted a lot of attention, was really the first [35:11] paper in the field [35:14] altogether that showed that [35:17] in medicine, the best way to attack the problem was these smaller, more specialized models. Again, that's become consensus today, but you have to sort of [35:24] pretend you're not listening to this today, pretend you're listening to this in 2022 pre-ChatGPT, it wasn't obvious because what was coming out at the time was like the chinchilla paper from DeepMind and everything was about larger, larger, larger, scale, scale, scale. And we just took this [35:40] In a way, like [35:41] is very, with the benefit of hindsight, everything's obvious, but [35:45] with the benefit of hindsight, it's kind of obvious, right? If you, if you, [35:48] You go and listen to... [35:51] Jensen's interview of Ilya, [35:53] Ilya uses the metaphor of JPEG compression, basically. It's like these language models are basically like a JPEG compression of the world. [36:01] And that's... [36:03] Okay, well... [36:04] if they're a JPEG compression of the world, what's the world? What's the world that you're compressing? And it goes back to what we talked about public internet. If you're doing a JPEG compression of the public internet, which is what these large language models that we're focusing on scale, where basically they're token limited. They're like, give me as many tokens as possible for me to train on. And so, well, where do you find all the tokens in the world? You

[36:29] to go back to Ilya's point, well, what are you compressing then? What are you JPEG compressing? You're compressing the public internet. And then you get all these sort of embarrassing outputs that were sort of that late 2022, early 2023 vintage. In our case, we sort of said, [36:42] Let's make a JPEG compression of medicine. And so let's let's overtrain on. [36:47] again, peer-reviewed medical science, stuff that comes out of the FDA, the CDC. Uh, we had the advantage, this is way before the New England Journal of Medicine partnership, but we had the advantage of, um, [36:58] that under copyright law, anything created by the US government is public domain. That's how Wikipedia does a lot of what it does. So in the early days, we started with... [37:07] the sort of like, [37:08] creative commons, public domain stuff that was available. And we were very lucky that in medicine, [37:14] This wouldn't work in every other field because in other fields like law or accounting or tax, there's a lot of stuff that's behind walls. But in medicine, it turned out that a lot of the really great stuff was created by the U.S. government in the form of the FDA and the CDC and what they had put out. So we overtrained on that stuff and saw the copyright issue that way early on, which then happened. [37:36] allowed us to bootstrap something awesome enough that people could download it. [37:42] which then won over users [37:45] at places where there were copyright considerations like the new journal of medicine [37:50] which then started the flywheel of them reaching out to us. And then now that's having the benefit of the stuff that is under copyright, the New England Journal of Medicine. [37:58] But that that was our approach. It was very technical and it was very academic and was very scientific because accuracy mattered that much, given our domain.

[38:09] in medicine. Yeah, I was going to ask you about that. So, you know, you have doctors using open evidence to make clinical decisions about [38:17] At the point of care. Yeah. [38:18] So most applications... [38:20] A hallucination is annoying. [38:23] With open evidence, a hallucination could be literally life-threatening. [38:27] given how it's being used. So how do you deal with hallucinations in particular? [38:31] Well, and just to reiterate the first thing you said, you know, and maybe this is advice for [38:37] entrepreneurs or engineers are listening to this [38:40] There's scenarios where hallucination is not even annoying. There's scenarios where hallucination is a feature. One of my favorite applications is mid-journey. Yeah. Hallucination is a feature. Yeah, yeah. Of mid-journey. [38:50] Maybe one takeaway is... [38:53] Find. [38:55] Applications [38:57] where the biggest hesitation... [38:59] actually gets Judah moved into a feature [39:02] Um. [39:04] as opposed to a limitation. And just a total aside, [39:08] An example and someone should go start this company again. My first company was in finance and I feel like I kind of grew up on Wall Street and I think that way and [39:19] If I... [39:20] wasn't [39:22] running open evidence. I wouldn't run another company because I'm going to work in medicine, I think, for the rest of my career because of the impact. But if I were pressed to sort of like, what would what would I do in finance now that large language models exist? [39:36] I would actually begin from thinking about hallucination as a feature of

[39:40] as opposed to a limitation. So where is hallucination a feature [39:45] In finance, well, it's certainly not in like doing retrieval on the P-E ratio. You need that to be right. [39:50] Thank you. [39:50] Well, [39:52] Where else could it be used? [39:53] What about risk management? [39:55] A lot of finance is about figuring out what the black swans are. Hmm. A lot of finances is, [40:02] What could go wrong? [40:03] And then at the extreme tail, there's a lot of money at stake. What is very unlikely, but that could go really, really wrong. [40:12] The first two questions most people can reason through without the aid of computers. What can go right and what can go wrong? You can kind of reason through that with your wet brain. But in terms of like what could go really, really, really wrong... [40:23] at the level of the 2008 financial crisis. Um, [40:26] That's harder for most unaided people. [40:29] brains to imagine that. But... [40:33] These language models would be pretty good, and I've tested some of this in my own portfolio management, at hallucinating those things. [40:40] I've actually... [40:42] as an experiment done this in my own portfolio management, just use these [40:48] language models [40:49] in a way that the hallucination is a feature where I give it certain details of my portfolio. Um, [40:56] I talk about the company. I, you know, I give it in the context window enough information so that I understand what the company does and so on. And it comes up with. [41:05] all sorts of scenarios. [41:07] that are kind of on the long tail of what could go wrong. And I'm like, huh.

[41:11] I never thought that... I love NVIDIA, but I never thought about that happening... [41:17] to Nvidia. That's interesting. So at a high level, [41:21] I think there's enormous opportunity. I think we're like 1% of... [41:26] the market captured [41:28] today in 2025 in terms of applications built that even begin to think about [41:35] hallucination or riffing as an advantage as opposed to as a limitation. So that's for all the entrepreneurs listening. There's 99% is still up for grabs. Yes, in my specific [41:47] Domain medicine, none of that is fair game. And so the way, you know, we had to deal with that is by not connecting open evidence and models that we train to the public Internet. [42:00] is by only training on peer-reviewed medical knowledge. [42:04] And go back to Ilya's point, the JPEG compression that we made in our models, in our in our smaller specialized retrieval models and ranking models. You know, we don't use one model without getting into our sort of trade secrets like it's an ensemble architecture. [42:22] there's multiple models that do different things. There's half a dozen models. They hand off tasks to each other. Uh, you can't get the accuracy level of open evidence by training one large language model. It's under the hood going to be this sort of cooperative ensemble architecture. And those are made up largely of smaller models that do very specialized things like retrieval and ranking and other things. And for those models, um,

[42:48] The JPEG compression is exclusively of peer-reviewed medical literature. So it's never... [42:53] going to be at risk of [42:56] regurgitating or surfacing something that is not in the peer-reviewed medical literature [43:02] which is, as they say in G.I. Joe, more than half the battle, right? And then the other half the battle is allowing transparency and interrogation [43:10] of the answer. And we were very early to that. I've seen now that ChatGPT and others start to do that, but we were probably the first application. I would go on a limb and say we're like the first application that grounded our answers. [43:23] uh... and [43:25] references that you could drill down and drill through to see the underlying sources of, we did that in early 2023, long before, [43:33] chat and others started to come out with similar features. And that's how we won over users in the early days because [43:40] Doctors saw that not only is this not saying anything egregiously wrong in terms of regurgitating something on the public Internet, but it's also... [43:46] even within the domain of the answers that it gives based on, [43:50] peer-reviewed medical literature, allowing me as the physician to go interrogate where it's getting that [43:56] thing that it's saying, where it's getting that source of information from, and drill down all the way to the reference, and then go and read the reference. Which, by the way, also created a beautifully symbiotic relationship with the publishers. Because instead of [44:10] just compressing all their knowledge [44:13] and then giving it away as some... [44:16] folks did, as a result of just trying to make this as accurate as possible, inadvertently stumbled upon a...

[44:24] model of cooperation with... [44:26] publishers that ended up being very good for them too, because we send an enormous amount of traffic to medical journals. We send [44:36] millions and tens of millions, tens and tens of millions of visits from doctors. [44:42] two medical journal pages hosted by those medical journals, including traffic they might not have otherwise have gone because the doctor is going to that journal because of [44:52] some detail deep in the methodology section that the doctor would have never known to go to that journal for. Really, this virtuous circle kind of all around. And then we had... [45:01] I'm [45:02] medical societies that write guidelines reaching out to us saying, hey, we noticed that you index [45:08] this other society's guidelines. Can you go index our guidelines? Because we want the traffic is beautiful, right? So you get accuracy, you get a symbiotic and a mutually beneficial relationship with [45:22] Medical journal owners. [45:24] But critically, you get the right information back to the doctor using open evidence who then will make the better decision as a result of having better information for their patient at the point of care. And it's been it's been a decade or so since Kinshaw got going. [45:38] And obviously there's been a lot of progress in the field of AI machine learning since then. If we were to inspect the underlying architectures of Kinsho, [45:47] And open evidence. [45:49] How much is the same and how much is different? And I guess part of the question behind the question is, how much of what goes into making an AI application that actually works is,

[45:58] is... [45:59] recent breakthroughs and how much of it is more sort of classical, [46:04] engineering machine learning principles. [46:08] Kensho was pre-large language models, pre-language models, pre-small language models, pre-BERT. [46:15] pre [46:16] "'Anything.' [46:17] Um, [46:18] almost pre-fire. [46:21] So... [46:22] Um, [46:23] it's hard to compare right i mean kensho was very early nlp not when i sold the company by the time i sold the company was much more sophisticated but i'm talking about when i founded kensho in 2013. so [46:34] It's very different today. What they have in common is... [46:38] There's an enormous infrastructure component to building this stuff. [46:42] So, [46:44] you know, we train our own models and I talked about that over the last few minutes and, and, but even if you're not training your own models, even if you're just like using an API to, you know, [46:55] one of the usual suspects. [46:57] you know, that's going to fall over. [46:59] at some point if you're successful and um [47:02] And you want to be successful and you want to get to the point where it falls over and it will fall over. And at that point, you need to have all the traditional things that you have in traditional software engineering like. [47:14] infrastructure and really good infrastructure. And that is very similar to Kensho because both were critical systems. In the case of finance, there's enormous amounts of money being moved around on the basis of this information. You can't have it just [47:28] stop or fall over in the middle of a trade. And I think that's a good thing. I think that

[47:33] One of the things that everybody was concerned about post the... [47:37] chat GPT moment was that all the rules of the game had changed. [47:41] And... [47:42] I'm here to sort of tell you that they haven't. [47:44] Yeah, the technology is better, but that's a continuum. The technology has always been better. The technology was better from 1989. [47:51] two or 83 to 1987 right and from 93 to 97 right the technology has always gone better yes there's a step function now yes there's non-linearity yes there's a exponential rate of increase yes everything ray kurswell said is correct and turned out to be correct but but [48:07] It's a continuum. You know, even Ray Kurzweil thinks about this stuff as a continuum. And when you think about something as a continuum, it's very... [48:16] It's a relief in a way because a continuum is something where the laws of physics aren't [48:22] changing [48:23] along the continuum, even if you think about the metaphor of [48:27] uh travel toward the speed of light yes the technology that would get us from one-tenth the speed of light to one half the speed of light in a spacecraft [48:35] is highly non-linear in its sophistication, [48:38] But the laws of physics in that acceleration are not changing. It's just the technologies on a non-linear continuum, but it's still a continuum. And that same continuum... [48:49] nonlinear but [48:50] continuum exists in engineering and entrepreneurship more broadly, but specifically in AI, where everything that mattered... [48:57] at Kensho.com. [48:59] um continues to matter today and the the intelligence level of the people that you're bringing to bear

[49:06] on the task matters. You know, Kensho and Open Evidence are identical in that we were able to be successful because we brought people with really high IQs to bear on the task. Let's talk about that. Yeah, you mentioned Zach and Evan and Eric and Micah. How do you... [49:23] How do you attract people like that? Why do they choose for all the options they have? Why do they choose to work on open evidence? [49:29] Thank you. [49:31] Yeah. [49:31] It's impossible for me to answer that without just... [49:35] Um. [49:36] repeating what Steve Jobs has said, which itself has been repeated so many times, but I don't have a better way of phrasing it. A players want to work with A players. [49:47] It's that simple. Elite people want to work with elite people. [49:53] A lot of people who... [49:54] sign up to buds, which is the sort of screening process for Navy SEALs. Um, [49:59] do so because they just want to see if they can keep up [50:04] with the other people that are doing it. They want to test themselves. They want to see what their limits are. [50:10] That's as old as Achilles. [50:12] That's not new. It doesn't matter whether it's warfare or... [50:16] engineering or sports or any other domain, finance, the very best people in the world want to see just how good they are [50:26] They want to see what they're made of. And the only way to do that, the only way to learn that is to put yourself in. [50:31] around other elite people and see how you stack up against those people. So that's the common denominator to what I did at Kensho that worked very well to what I'm doing here that's working out very well, which is, you know, and it's kind of controversial, or at least was controversial for a minute. You know, you couldn't talk about,

[50:52] IQ. [50:53] Hmm. [50:55] You couldn't say out loud for a while, like, I just want people with really high IQs. [50:59] I don't care about anything else. [51:01] That's fun. [51:03] I don't care. [51:04] who you are, what your background is, what you look at. I just want someone with a really, really high IQ. [51:09] Um... [51:11] But that's the honest truth. I just don't know. I don't know how to sugarcoat it. I don't know how to say it differently. I don't know how to talk around that fact. [51:18] And so, you know, if you think about the people on, you know, the first... [51:23] four or five people, Zachary Ziegler, Jonas Wolfe, Evan Hernandez, Eric Lehman, Micah Smith, that that [51:30] came together, sort of senior people on my team initially, and [51:35] Yeah, every one of them, if... [51:38] if I have to sort of [51:40] classified this way, you know, came from a PhD program at Harvard or MIT. [51:45] But that's not because I'm like, I'm only going to recruit from Harvard and MIT. It was because I had the Kensho experience and I learned from that experience that if you bring very high IQ people with very high velocity of learning to bear on a very difficult problem, they make more progress. [52:04] far more quickly than a team a hundred times that size that's a more normal team and um [52:11] I think the really reassuring thing for everybody listening is... [52:15] in this moment is the rules of the game haven't changed. The physics haven't changed. All the things that used to matter still matter.

[52:23] an elite team, high IQ people, high velocity people, hungry people, [52:28] very motivated people, people with very high neuroplasticity. [52:33] And by the way, when I say high IQ, what I mean is high neuroplasticity. I mean something very neurologically specific. I don't mean speed at solving a Rubik's cube, which actually doesn't necessarily correlate very highly. It's the French Francois Chalet definition of the ability to efficiently acquire new skills. Absolutely. It's it's the it's it's the ability at which you can learn completely new information and assimilate that new information. That's what I mean by very high IQ. And. [53:01] And [53:02] And guess what? That mattered a thousand years ago, mattered 3000 years ago. The domain was different. It showed up in warfare and tactics and Sun Tzu and those sorts of things. [53:13] whatever humans were doing at any moment in history, [53:16] What mattered was neuroplasticity. [53:19] I spent a lot of time reading in my personal life von Clausewitz and Machiavelli and Sun Tzu and the history of warfare. It's a subject I'm very interested in. And... [53:32] And the history, of course, Napoleon and Alexander the Great and these folks and [53:37] It's all just neuroplasticity. You know, if you had to sort of say in a few words what differentiated these people, [53:45] I mean, none of these people were the physically largest people in their armies, not even close. [53:51] What they all had in common is you...

[53:54] the, the, [53:55] The facts on the ground could change very rapidly, as tends to happen in war. [53:59] and they're [54:01] thought not just their decisions, but their entire frameworks for thinking would just like adapt. [54:09] That's the quality that like a Napoleon or an Alexander the Great had, which is, [54:14] Yeah, they overprepared for the battles that they went into and thought through every single thing that the adversary could do. [54:23] None of that preparation, [54:25] Would. [54:26] exactly match [54:27] to what happened [54:29] in the battle and [54:31] What differentiated them from even very good generals or very good military leaders is they would just completely adapt their way of thinking about the battle to the facts on the ground that were developing in real time in the battle. And that's, you know, the standard way of describing that as neuroplasticity, or at least in some branches of cognitive science, it's just very high neuroplasticity individuals. So what humans have been doing. [54:55] over the last, let's say, 3000 years has kind of changed a lot, right? We're [55:00] I mean. [55:00] Unfortunately, they're elements of what humans... [55:03] we're doing 3,000 years ago that persist to this day, and the war does persist. But not everybody today in [redacted address] that might have been the case during the time of the Greek city-states. You know, people, thankfully... [55:16] today that are engaged in things other than city-state warfare. But [55:21] What hasn't changed are sort of the neuro processes and cognitive qualities that are

[55:28] required for outlier success. [55:32] Awesome. Let's jump into a lightning round. [55:36] Sure. [55:36] Keh. [55:38] Question number one. [55:40] I know this number is impossible to measure, [55:43] because it requires a counterfactual [55:45] butts. [55:47] We suspect that the way open evidence is being used. [55:51] It's. [55:51] saving lives like it's helping doctors make better clinical decisions. [55:55] On what date? [55:57] Thank you. [55:58] Will we be able to say that open evidence has saved a million lives? [56:03] a million lives. Well, [56:06] In a way, this feels like a McKinsey interview because you've got a sort of reason for like, well, if you have 150,000 or 500,000 doctors using it and those doctors each see a certain number of patients and what percentage of those patients are in life-threatening situations, I'm doing this sort of- Can I tell you my math? Yeah, yeah. You tell me your math. My math is, you know, it depends on where you look, but kind of 300,000 to 800,000 lives per year lost due to just straight up medical mistakes. Not all of those are going to be attributed to doctors making decisions at the point of care. There could be other things that happen. [56:36] but let's take the low end of that 300,000 let's cut it in half that's 150,000 [56:41] That says it's about six and a half years, you know, until you get there. And that's a fully ramped open evidence. So we'll give you a couple of years to keep growing. [56:48] I don't know, maybe eight or nine years from now. So we'll call it like 20, we'll call it November 4th, 2034. [56:56] I'm going to use this as an interview question.

[57:00] The only thing I would add is, you know, maybe in the 2030s, you have a million lives saved through the use of open evidence. But what that doesn't count is the patient. [57:10] today. [57:11] whose MS didn't get worse because the dermatologists used... [57:15] uh the wrong biologic and that's happening today right and and for every [57:20] black and white life saved. You know, there are those examples. There was a doctor who uses open evidence in Rhode Island who wrote us that he saved his patient's life by using open evidence to reason through whether the patient's presentation of symptoms was consistent with a pulmonary embolism and literally used open evidence as like a curbside consult to sort of reason through that patient's presentation of symptoms, realizing that actually it was the patient's presentation [57:50] They rush the patient back to the emergency room and save that patient's life. So lives have already been saved through the use of open evidence. And we know that because doctors tell us that. But for every one of those things that happens, it's just, you know, the MS not getting worse or it's some comorbidity not getting worse. That's in the order of millions today. Yeah. [58:09] Broad domain. [58:10] general purpose foundation models. [58:13] They are commoditizing. Yes or no? [58:17] I think they're getting better and better. I think the costs are coming down. I think everything Ray Kurzweil says is typically always right. [58:24] So... [58:24] you know, the frontier of the frontier, um, [58:27] doesn't get commoditized. It's always the frontier, but you know, they, yeah, the costs are going to, the costs of the wow factor that the first chat GPT produced,

[58:36] Yes, are going to converge to zero, which is why I think all the interesting stuff is going to increase in from a business perspective. All the there's still phenomenally interesting work being done at the foundation model layer intellectually, academically, scientifically from a business perspective. I think so much of the interesting. [58:53] work. [58:54] the great companies to be blunt are going to be at the application. Yeah. Well put, well put. [58:59] Um, [59:01] AGI. [59:03] On what date? [59:04] Did we or will we? [59:06] Reach AGI. [59:09] I think we've already reached it. We keep moving the goalposts. We've reached AGI. We've passed the Turing test. And even so we just keep moving the goalposts on what AGI is. What people really mean when they talk about AGI is consciousness and they don't know how to say that. So what they really because like they try to sort of say, well, it's this thing or it's this other thing. And then the AI does that thing. And like, well, it's the ability to have. [59:31] high school level expertise in multiple different fields. Okay, it reaches that. Fine, fine. It's not that. AGI is college level expertise. And then it reaches that. And now it's like, [59:41] you know, PhD level expertise in everything from coding to medicine, that would be AGI. That's never going to, and then it reaches that. What they really mean is consciousness. [59:51] That's what people I think. [59:53] underneath it all [59:55] mean when does a when do you get what you get in the movies when an ai becomes aware and conscious [1:00:01] I'm not sure that ever happens because I don't know that consciousness is an emergent. [1:00:05] property of a sufficient density of a neural network. That's a philosophical question. Yeah. Yeah. For AI founders, AI builders, AI fans.

[1:00:17] Other than this podcast, what one piece of content should they consume? [1:00:23] uh... [1:00:25] Ted Chang's novella, Understand. Okay. Tell us why. I want you to have the joy of experiencing it. I won't... [1:00:34] I won't spoil the story. It's a, it's a, Ted Chang is one of the great science fiction authors of all time. He wrote Arrival, which became a major motion picture. And the novella Understands [1:00:47] was written in the early 90s, and it is the best encapsulation of what [1:00:55] without any spoilers... [1:00:58] It is the best encapsulation of what... [1:01:02] non-linear, [1:01:05] acceleration and intelligence looks like. Hmm. [1:01:09] it's my touchstone for everything that I do. Most people expect a nonfiction answer. There's great nonfiction. There's tons of nonfiction reading, including just like, go read the chinchilla paper. Um, [1:01:23] gray paper. If you want [1:01:25] really just a touchdown for what it is that's happening now. [1:01:29] uh in our civilization right now it's this ted chang story understand because that just captures narratively um [1:01:36] really the feeling of nonlinear acceleration. Yes. Awesome. Love it. All right. Last question. [1:01:42] Thank you. [1:01:43] What is the most optimistic or positive message

[1:01:47] thing that you can imagine AI bringing to the world in the next couple of decades. How will all of our lives be better thanks to AI? [1:01:56] I have to go with a kind of an extrapolation of the field that I'm kind of obsessed with, but which is not. [1:02:05] truly possible today. [1:02:07] which is... [1:02:09] Personalize. [1:02:10] Medicine, by which I mean... So personalized medicine has been just over the horizon. It's kind of like quantum computing. It's kind of like fusion. You know, it will happen on some civilization scale. It's been just over the horizon for a very long time. What it means... [1:02:26] changes in a way we've been talking about it this whole time because, um, [1:02:31] using open evidence to say that, hey, if you have psoriasis in a mass means you should use this biologic versus this other biologic. That is the beginning of personalized medicine that's personalized to your comorbidity versus any other person with psoriasis. But that's just scratching the surface of what personalized medicine can be. You know, I think in 10 years from now, whether it's open evidence or whether it's a constellation of these types of AIs, [1:02:53] the exact specific fact pattern. [1:02:57] of your specific medical case. [1:02:59] is going to be matched to everything that is known... [1:03:03] in the entirety of medical knowledge. [1:03:05] about everything that is relevant to your case and, [1:03:08] A. [1:03:10] plan of care is going to be formulated that is hyper-tailored to everything. [1:03:16] that is specific to you.

[1:03:17] and that is specific about your case. And I mean, to me, that's just enormously exhilarating. And I think that is just over the horizon, but that is feasible and that will change [1:03:28] That's how you really start to [1:03:30] push the ceiling on life expectancy. That's how you start to get into maybe 120, 130 is no longer the ceiling anymore. And you get into these sort of ancient Greek [1:03:41] metaphors and paradoxes of Theseus' ship and replacing every plank [1:03:47] On. [1:03:48] The ship. [1:03:49] to the point where there's no plank in the ship anymore. That was the original plank, but you're walking around and you still have your memory of your wife and your child and your relationship to them. And you're still alive to, to watch your own child turn a hundred and those things. And, um, [1:04:03] I'm an optimist in that regard. I have a... [1:04:07] atomistic view of human biology. And I think the the feceship approach to human biology is just over the horizon. And a lot of it turns on the sort of personalized medicine stuff. [1:04:18] Awesome. [1:04:18] Daniel, thanks for joining us. Thanks, Pat.

[1:04:48] you