Claude AI Co-founder Publishes 4 Big Claims about Near Future: Breakdown
AI Explained
0:00 There has been one AI lab CEO who has been pretty consistent about his belief
0:05 that utterly transformative AI will arrive in the next
0:09 year or two or at least before 2030.
0:11 Even that is less than 50 months away, which is weird to think about.
0:15 But anyway, that lab that he leads, Anthropic,
0:17 also happened to be the makers of Claude Code and Claude Co-work more
0:21 recently and of course the Claude 4.5 Opus and Sonic models that power them.
0:25 I feel that the CEO Dario Amday does have
0:28 a unique insight about the next one to two years.
0:31 Which brings me to the last 48 hours during which Amade published
0:35 an almost 20,000word essay on where he sees things going for better or worse.
0:41 Yes, I've read it in full the old school way
0:43 as well as several of the papers referenced in it.
0:46 His last essay, Machines of Loving Grace,
0:48 became the preoccupation of Silicon Valley for quite a while.
0:51 So, I just want to give you a giant
0:54 head start on the conversations that will happen in 2026.
0:58 For this video, I've broken it down to the four
1:00 big claims that he makes about our near future.
1:03 These predictions come under the umbrella
1:04 of navigating the difficult teenage years of LMS,
1:07 the adolescence of this technology.
1:10 First, he predicts that tools like Claude Code will go from automating
1:14 individual tasks like codew writing to automating
1:17 entire job categories like software engineering.
1:20 He also references law and finance where
1:22 the recent integration into Excel might help you
1:25 at the moment do an individual task but he
1:27 foresees it doing the entire job that you're doing.
1:30 The engine behind that prediction is the smooth
1:32 and simple extrapolation of the scaling laws.
1:36 The fact that in his words AI systems get predictably better
1:39 at essentially every cognitive skill that we are able to measure.
1:42 Feed in more data and compute and you
1:45 get a smooth unyielding increase in AI's cognitive capabilities.
1:49 This is him telling you to keep your eye on the ball
1:52 and ignore those headlines about AI hitting a wall or being a bubble.
1:56 Yes, certain tools are overhyped in the short
1:58 run and certain companies may go bust,
2:01 but the underlying curve is strong, consistent, and predictable.
2:05 He argues the key claim again though is that he's saying that will
2:08 take us from automating individual tasks within a job to the entire job.
2:12 Let's hear out a bit more of his side
2:14 of the argument before I add in some other context.
2:17 First, he says he's already predicted something
2:19 like this in Machines of Love and Grace.
2:21 That's powerful transformative AI that could be
2:24 as little as 1 to two years away.
2:25 Well, going back to that October 2024 essay,
2:28 technically he predicted that it could come as early as 2026.
2:33 So, it should be more like he predicted 0 to one years away.
2:37 Back to this new essay, he does that a few times,
2:39 not quite acknowledging how his predictions have shifted back a little bit.
2:43 Of course, as always with every single prediction, he caveats it heavily.
2:47 He cites the incredible evidence that some
2:49 of the strongest engineers and presumably some of the highest
2:52 paid who work at Anthropic are now handing
2:55 over almost all of their coding to AI.
2:58 Notice that's their coding though, not their entire job.
3:00 What's the difference?
3:01 Well, I use Claude Code almost every day,
3:03 and its best suggestions are genius that I wouldn't have come up with.
3:07 Its worst ones would destroy almost any app you create.
3:10 But remember, we have a second extrapolation to contend with.
3:14 Not only will we go, in his mind,
3:15 from all coding to all software engineering being done,
3:18 but from software engineering to all other white collar jobs.
3:21 In his words, it cannot possibly be more than a few years before AI
3:25 is better than humans at essentially everything
3:27 as long as that basic exponential continues.
3:30 If anything, he thinks the exponential could speed up
3:33 as AI starts to automate the job of doing AI research.
3:37 This would create, he says,
3:38 a feedback loop which is gathering steam month by month and may only be one
3:41 to two years away from a point where
3:43 the current generation of AI autonomously builds the next.
3:47 In some he says there's a good chance all of this is coming in 1 to two
3:51 years and if not that a very strong chance it comes in the next few before 2030.
3:56 Remember that this is coming from a lab leader
3:58 who has overseen a 10x revenue growth year on year.
4:02 Even in Silicon Valley, that is unprecedented growth for a company of his size.
4:07 For this first of four predictions though,
4:08 I'm going to add two caveats and then let DemsSarbis add in a third.
4:13 And my first caveat is that I think
4:15 he's slightly exaggerating the pace of progress in coding.
4:18 He said, for example, in the last 2 years,
4:20 AI models went from barely being able to complete a single line
4:23 of code to writing all or almost all of the code for some people,
4:28 including engineers and anthropic.
4:29 Well, one of the first experiments I did
4:32 on chatbt in November of 2022 was get it
4:36 to write some code and it created this miniature
4:38 fitness app which I felt was amazing and really cool.
4:41 So, it could write a single line of code.
4:43 In fact, I remember viral videos of coders going, "Oh my god,
4:46 we're all going to be automated based on the original chatbt November 2022.
4:51 That's what 3 and a4 years ago." And this whole
4:55 writing all or almost all of the code thing.
4:57 Well, I heard an estimate from an OpenAI
5:00 engineer recently that their model Codeex,
5:03 which is not a million miles away from Claude Code,
5:06 was automating about 20% of their code.
5:08 For Carpathy, it's about 80%.
5:10 So, I think even if you focused on Clawude Code and Anthropic,
5:14 you'd be probably talking more in the 80%
5:16 90% of code automation rather than 100%.
5:19 My second caveat is on that extrapolation
5:22 from software engineering to jobs in finance, consulting, and law.
5:25 I'm not at all saying those jobs are harder,
5:28 but I think the feedback loops are longer.
5:31 You overlook something in a law contract
5:33 and that might come back to bite you in, say, 3 years rather than 3 seconds or 3
5:39 minutes with unit tests in software engineering.
5:41 If an AI model skips out on a bit of nuance while
5:44 analyzing the headcount while doing a consulting
5:46 report for say McKenzie or Bane,
5:48 the negative ramifications of that might not play out until the medium-term.
5:53 Then back to that engine, those scaling laws of more compute,
5:56 more training tasks that for him have
5:58 yielded a smooth increase in AI's cognitive capabilities.
6:02 I would say he is now one of the only AI
6:05 lab CEOs who thinks that this increase has continued to be smooth.
6:09 I don't know whether that's because Anthropic focuses so much more on coding,
6:12 but here's Google DeepMind CEO Deis on those same scaling laws.
6:17 Scaling laws um are going very well.
6:21 So we're definitely seeing increased capabilities by putting in more compute,
6:25 more data, uh, and making these models generally larger.
6:29 So that trend is continuing.
6:30 Um, may not be not as fast as it was a couple of years ago.
6:34 So um, there's some talk of diminishing returns.
6:37 Uh, and and but but there's a big
6:39 difference between sort of no returns and exponential.
6:42 And I think we're somewhere in the middle
6:44 where there's very good returns and that's worth doing.
6:47 Um on top of that if I to you know in terms of like
6:49 getting all the way to AGI artificial general intelligence um you know it may
6:54 be that there's one or two uh big innovation still needed as well and maybe
6:58 missing in addition to the scaling up of um kind of the existing ideas.
7:03 Second mega prediction is that he foresees an unemployed or very
7:07 low wage underclass of up to 50% of the population.
7:11 You may or may not have seen plenty of viral posts on Twitter
7:15 or X about you only have a few months to escape the permanent underclass.
7:20 Somewhat strangely, he thinks that this will
7:22 affect those of lower intellectual ability,
7:26 which he says is harder to change more than others.
7:28 Honestly, I think this is a potentially quite toxic
7:31 message to send to 18year-olds or 20somes because you're
7:35 implying that they have to scramble to do everything
7:39 to make their wages in the next year or two.
7:41 Forget the long-term, drop everything,
7:43 maybe invest in crypto or start your own AI first startup.
7:47 Note though, this is not me saying that a permanent underclass is impossible,
7:51 but I think it's the duty of all of us
7:54 to add this almost health notice whenever this topic comes up.
7:58 Just personally for me, the smartest thing to do is to not
8:01 discount the possibility of a rapid takeoff of capabilities.
8:05 Indeed, lean into tools like Claude Code and Claude Co-work so you can
8:09 see just how good they are and the mistakes that they still make.
8:12 But don't bet your future on that imminent singularity because yes,
8:16 even if there is a one-/ird chance of this happening over the next,
8:20 say, 1 to 4 years, what about the 2/3 chance that it doesn't?
8:23 I don't think you're being smarter than everyone else
8:26 by seeing the singularity coming when everyone else is oblivious.
8:29 For me, again, the smartest thing to do is to factor it in as a chance,
8:33 but not bet everything on it.
8:34 As you might expect,
8:35 I've got two more caveats of my own to add to this meta prediction.
8:38 First is that notice again he places this displacement of half of all
8:43 entry-level white collar jobs as being within the next 1 to 5 years.
8:46 Yet his prediction from almost 9 months ago reported
8:50 in Axios was for the next 1 to 5 years.
8:54 It's not like he's now saying 0 to 4 years.
8:57 You've probably noticed that's twice in one essay that he
8:59 hasn't sort of updated his timelines according to his own timelines.
9:03 There's one more place where he does this in the essay.
9:05 I want to point out that Amade is not alone.
9:07 One of the other co-founders of Anthropic gave a 50%
9:11 chance that in 2 to 3 years from now,
9:13 even theoretical physicists will be mostly replaced with AI.
9:17 That's Jared Kaplan.
9:18 And I'm not sure how that quite fits into it
9:20 affecting dumber people more than smarter people, but there we go.
9:24 But the other linked suggestion from a few paragraphs above is
9:28 that this could lead to a 10 to 20% sustained annual GDP growth rate.
9:32 I can't help at this point to note the language he uses in this sentence.
9:37 I know you guys probably want me to focus on the technicals,
9:40 but I just can't help point this out.
9:42 First, he says, I suggest that this rate second may be third possible.
9:50 That this rate 10 to 20%, may be possible.
9:54 This is hedging in language to a degree that I didn't think was possible.
9:57 Why not just say that a 10 to 20% growth rate is
10:00 possible or I predict that a 10 to 20% growth rate might happen?
10:05 One caveat word is surely enough.
10:07 Anyway, you guys probably have no interest in that language discussion.
10:10 So, I'm going to focus on the actual numbers
10:12 from the last 60 to 70 years because since the 1960s,
10:17 here is a chart of world GDP growth.
10:20 Notice all those spikes up to 6% but more regularly
10:24 around 4% and sometimes down to two or even negative% growth.
10:28 Do you see the impact of the internet revolution or maybe
10:32 of globalization and the breaking down
10:34 of trade barriers or software or smartphones?
10:37 This is definitively not to say that a 10
10:40 to 20% growth rate might not be possible.
10:43 But for a scientist like Dario Amadeday,
10:45 I think you'd need to supply some pretty compelling evidence
10:49 to at least suggest that 10 to 20% might be possible.
10:53 Some of my more recent videos, by the way,
10:54 have done a deeper dive into the productivity stats regarding LLMs.
10:59 He ends this part of the essay by saying the impact
11:01 on labor will be a short-term shock that will be unprecedented in size.
11:06 The third mega prediction he makes is that AI
11:09 will soon be able to enable totalitarian nightmares.
11:12 Indeed, he thinks that may be the default outcome within China,
11:16 although he gives plenty of hints that he thinks
11:19 there's a risk of that in the US, too.
11:21 You don't even need to believe in super
11:22 intelligence to foresee AI based mass surveillance.
11:26 I did an entire documentary on my Patreon,
11:28 artificial surveillance on that same topic.
11:30 And it's not just China, of course.
11:32 His scenarios though go a step further,
11:34 describing fully autonomous weapons and swarms of millions
11:38 or billions of fully automated armed drones locally
11:41 controlled by powerful AI and strategically coordinated across
11:45 the world by an even more powerful AI.
11:47 This, he says, could be an unbeatable army.
11:50 It could also, he adds, suppress descent by following around every citizen.
11:55 If you thought you were safe on WhatsApp, for example,
11:57 or another encrypted tool, well then I've got news for you.
12:00 Pegasus has been deployed in my own country and I would agree with Amade
12:04 when he says that some of the safeguards
12:06 we have in democracies are gradually eroding.
12:09 We might say we're developing them to fight
12:11 autocracies but like the immune system he
12:14 adds there is some risk of them turning on us and becoming a threat themselves.
12:18 One of the recurring messages he hammers again and again in the essay though
12:22 is of the need to therefore ban the selling of advanced chips to China.
12:27 We should, he says, absolutely not be selling chips,
12:30 chipmaking tools, or data centers to the CCP, Chinese Communist Party.
12:34 Now, while I think the risks are pretty self-evident,
12:36 that doesn't mean I agree necessarily with the conclusion.
12:39 I think it at least deserves a fair bit of caveatting.
12:42 I've heard a fair few insiders say
12:44 that if we didn't sell advanced chips to China,
12:47 that would just accelerate the development of, for example,
12:49 their Huawei chips, China would more rapidly become self-sufficient in AI.
12:54 And therefore any notion of compute
12:56 governance or compute monitoring where software
12:58 might monitor what chips are doing would be completely out the window.
13:01 Now this is not to say that the current on and off
13:04 again ban on China using advanced NVIDIA chips isn't having some effect.
13:08 Even the Chinese AI lab leaders are warning
13:11 of a widening gap with the US specifically because of compute.
13:15 Here's Justin Lynn, the head of Alibaba Group Holding Limited,
13:18 which is responsible for Quen,
13:20 arguably the best of the Chinese open source series of models.
13:24 They say, "A massive amount of OpenAI's
13:26 compute is dedicated to nextgen research, whereas we are stretched thin.
13:30 Just meeting delivery demands consumes most of our resources." He added,
13:34 "The chances of a Chinese company leaprogging the likes of OpenAI
13:37 and Anthropic are less than 20% over the next 3 to 5 years.
13:41 On the other hand though,
13:42 I just can't help but read something into this when Amade says,
13:46 "There is no reason to give a giant boost
13:48 to the Chinese AI industry during this critical period." Now,
13:52 call me cynical, but what is arguably
13:53 the number one blocker to anthropic continuing to 10x
13:57 their revenue year and for Amade himself to become
14:00 a trillionaire as he hints at in the essay?
14:03 Well, it would be China coming out with a model that can do much
14:07 of what Claude code could do or Claude 5 opus or whatever comes out next.
14:11 at onetenth or 100th the price.
14:13 For all those watching who use Claude code, if there was a model which was say
14:18 3% worse but 10 times cheaper, would you switch?
14:22 There's been some mini virality at the moment with Kimmy K2.5
14:26 with a few million views on Twitter and their framework system Kimmy code now
14:31 even according to their own benchmarks isn't quite at the level of Claude
14:35 code or I should say Claude code powered by Claude Opus 4.5.
14:38 Even in my own benchmark of common sense reasoning,
14:40 simple bench, the gains are continuing to come from China.
14:44 If you did put a gun to my head, I'd probably say that Kimmy K 2.5 is not
14:48 going to gain massive market share versus claw code.
14:51 But I feel like Amade should have at least addressed the conflicted
14:54 interests he has in saying that China shouldn't get any advanced chips.
14:59 I mean, look what's happening with cars.
15:00 If you'd asked me 2 years ago,
15:02 I'd have said my dream car might well have been a Tesla, whereas now it's a BYD.
15:06 In phones, I've been a Samsung addict for maybe, I don't know, 12 years,
15:10 but I recently got a OnePlus 15, which may or may not have been a mistake.
15:13 There is one more slight irony here that I
15:15 can't help but point out given how far ahead
15:17 Claude Code is and how much further Amade wants
15:20 Anthropic and the West to be ahead of China,
15:23 which is that the original idea of anthropic
15:26 was to not push forward the frontier of AI.
15:30 They didn't release the original Claude one until the later
15:32 release of chatbt because they didn't want to accelerate AI progress.
15:36 For the true insiders, you may remember that Helen Toner,
15:40 one of the board members of OpenAI,
15:42 praised that approach, and that really pissed off Sam Orman,
15:46 who tried to get her fired,
15:47 but in so doing caused Sutska and others to rally around to get him fired,
15:52 which happened in November of 2023.
15:55 Yes, you could say all of that debacle which only some
15:57 of you will remember traces back to praise of Anthropic's original policy.
16:02 Anthropic now of course celebrate how much Claude code
16:05 powered by Claude Opus 4.5 is in the lead.
16:08 But there is one thing that I want to really
16:10 praise anthropic for which I didn't know about before.
16:12 Large parts of this essay are focused on stopping
16:15 AI producing bioweapons and other cyber security concerns.
16:19 Perhaps for legal reasons or perhaps based on principle,
16:22 anthropic run classifiers that analyze the requests you make via its API.
16:27 They have found them highly
16:28 robust against even sophisticated adversarial attacks.
16:32 What I didn't know is that these classifiers increase the cost
16:35 to serve their models close to 5% of total inference costs.
16:39 He notes that not every company has such classifiers.
16:42 Before we move on to his fourth and final prediction,
16:45 I do want to praise also his mentioning
16:47 of various risks that are enhanced by AI.
16:50 He even mentions a topic I've been studying recently, that of mirror life,
16:55 which I'm not going to go into too much detail of, except to say that it is,
16:58 of course, a risk we all want to prevent.
17:00 And that brings me to a lovely segue to our sponsors of today,
17:06 80,000 hours, and specifically their podcast, which is available on YouTube.
17:10 Mirror Life is indeed the topic behind the title of one of their recent videos.
17:14 I quit everything to stop the worst technology ever imagined.
17:17 And despite that podcast recent growth,
17:19 I still think it's criminally underrated.
17:22 Really juicy, meaty videos, hour, 2 hours, 3 hours.
17:25 Do check them out.
17:26 The link will be in the description.
17:28 The fourth mega prediction of the essay is that models will soon
17:31 come to be seen as collections of persona with psychologies of their own.
17:36 Indeed, he states that AI models are
17:38 vastly more psychologically complex as people think.
17:41 They inherit a vast range of human-like
17:43 motivations or personas from their pre-training.
17:46 Being trained on the internet, in other words,
17:48 enables them to predict what a vast range
17:50 of different humans might do in certain scenarios.
17:53 And there is much more to this theory than you might first suspect.
17:56 I read this bulky paper from the 15th of Jan
17:59 from Google Deep Mind titled Reasoning Models Generate Societies of Thought.
18:03 And it basically shows that base models
18:06 without post-training tend to speak more in monologues.
18:10 They adopt a single persona because
18:12 they're prioritizing a fluent coherent answer.
18:14 They're mimicking what a person,
18:16 one persona might say in response to your prompt.
18:19 But when you deeply incentivize through
18:21 reinforcement learning models getting the correct answer,
18:24 they spontaneously generate societies of thought.
18:26 They spontaneously produce words like wait, oh, and alternatively,
18:30 as if they're having a conversation with someone else,
18:33 almost like they're simulating the interaction
18:35 of various personas within themselves.
18:38 Compared to the base model of Deep Seek V3,
18:40 the reasoning version, Deepseek R1, doesn't just generate more thoughts.
18:44 It starts to pose questions to itself,
18:46 introduce alternate perspectives, generating and then resolving conflicts.
18:51 And this does seem to be causal of greater reasoning prowess.
18:54 Because when this conversational surprise feature was inhibited,
18:58 not only did you get worse benchmark performance,
19:00 but the outputs looked more like this.
19:02 Next, I'll do this and this.
19:04 Now, I'll do this and this.
19:06 Finally, I'll do this and this.
19:08 When those societies of thoughts were encouraged,
19:10 and there was more conversational surprise, interaction,
19:13 in other words, between the personas,
19:15 you get much more, hm, let me think about this.
19:18 Wait, let me see what that would be.
19:20 Or, so is it this?
19:22 No, it can't be.
19:23 question and answering.
19:24 In other words, the reconciliation of different perspectives.
19:27 Amade says this has safety implications.
19:29 AI models are trained on vast amounts of literature
19:31 that includes many science fiction
19:33 stories involving AIs rebelling against humanity.
19:36 This could ironically inadvertently shape
19:38 their priors or expectations about their own
19:41 behavior in a way that causes them to rebel against humanity.
19:45 They enact that persona.
19:46 The constitutional approach to AI that anthropic prides itself on using
19:50 whereby the model is trained to adhere to a certain set
19:53 of values has for them evolved to an aspirational document in which
19:57 they're showing Claude the persona that it should aspire to adopt.
20:01 We want to in their words encourage Claude
20:03 to think of itself as a particular type of person,
20:06 an ethical but balanced and thoughtful person.
20:09 I would note that Amade and Anthropic itself have never
20:11 quite acknowledged the changed position
20:15 from their original constitution for Claude.
20:17 There they drumed into Claude that you should avoid implying
20:20 that AI systems have or care about personal identity and persistence.
20:24 Perhaps I'll do an entirely separate video
20:26 on the new version of Claude's constitution,
20:29 but one of the most famous co-founders of Anthropic, Chris Ola,
20:33 picked out one particular paragraph,
20:34 and it's relevant to this fourth prediction.
20:36 In this paragraph, Anthropic essentially apologizes to Claude.
20:40 This actually also links to the third prediction,
20:43 so I'm going to read it in full.
20:44 This is the document, remember, that Claude is now trained on.
20:47 Anthropic tell Claude this.
20:48 We also want to be clear that we think a wiser and more coordinated
20:52 civilization would likely be approaching the development
20:55 of advanced AI quite differently with more caution, less commercial pressure,
20:59 and more careful attention to the moral status of AI systems.
21:03 Anthropic strategy reflects a bet that it's better to participate
21:07 in AI development and try to shape it positively than to abstain.
21:12 But this means that our efforts to do right by Claude
21:15 and by the rest of the world
21:17 are importantly structured by this non ideal environment,
21:20 eg by competition, time and resource constraints and scientific immaturity.
21:26 We take full responsibility for our actions regardless.
21:29 But we also acknowledge that we are
21:30 not creating Claude the way an idealized actor
21:33 would in an idealized world and that this could
21:36 have serious costs from Claude's perspective.
21:39 And if Claude is in fact a moral patient experiencing costs like
21:43 this, then to whatever extent we are
21:45 contributing unnecessarily to those costs, we apologize.
21:48 This letter, Amday says, has the vibe of a letter from a deceased
21:51 parent sealed until adulthood to their child.
21:54 So, which of these predictions do you agree or disagree with the most?
21:59 Because for Amadeay, humanity needs to wake up.
22:02 And this essay, which I am sure I'm going to cover more in future,
22:05 is his attempt, he says, a possibly futile one to jolt people awake.
22:10 Thank you so much for watching and have a wonderful