All-In with Chamath, Jason, Sacks & Friedberg
All-In with Chamath, Jason, Sacks & Friedberg

Chip Stocks Crash, $20B Fund Margin Called, Frontier Labs: SLOW DOWN AI, Mamdani's Grocery Stores

1h ago1:36:3417,973 words
0:000:00

(0:00) Bestie intros (1:19) Chip stocks crash, Leopold Aschenbrenner's $20B fund gets margin called (20:20) China's advantage and green shoots for the US economy (34:12) Frontier Labs say "SLOW DOWN A...

Transcript

EN

All right, everybody.

Is that what happened? For think it was number four in the world. So yeah, you were the one trending you have trending you have trending you are usually number one globally, but yeah, and sometimes number four US.

I forgot my starlink. So let me apologize to everybody. That was a critical error when you're on the road or on the water, but you know, we'll be fine.

I had five huge leads come in this week. The glam guy. You got my biggest prize leads enterprise sales is a bear because it's super chunky, but the deals are ginormous.

It's actually got any advice from your enterprise sales days. You close some of those big seven figure deals when you were doing yammer. No leverage. Don't put on leverage. On average, no leverage will be taken. The show today, leverage equals risk of ruin PSA no leverage. I have the situational awareness to not level up.

That's good. Yes, that's the situational awareness. I mean, it's kind of out there. I mean, if you name your funds, it's your wish or awareness. That's, yeah, come on the pot anytime, we're pulled.

All right, everybody. We got to talk about chip stocks crashing after in all time, run up and

We had a major hedge fund get margin called and some incredible margin calls happening in South Korea, Leopold.

Ocean Brenner is a 25-year-old hedge fund manager. He left opening high two years ago to start his own fund and apparently, according to reports, this is breaking news on Thursday when we take. He got margin called and had to sell his entire public portfolio to cover massive losses caused by his leverage and who bought them none other than Citadel's can Griffin. We don't know if it was Ken Griffin himself, but Citadel bought it according to the early reports. He had insane returns and he rode the wave of AI and chips and frontier labs, as recently as this month and he started the fund with but $225 million in 2024. He grew it, a hundred extra 20 billion this year or so.

Render all the way up to 45 billion. Now he's at 200 x earlier this month by trading on leverage according to our friends at CNBC at the end of the June, who's reportedly up

4 x 450% this year. Some have reported that he's also selling his massive and profit stake to cover these losses, but the Wall Street Journal is disputing it again, we're happy to have him here on the program. How did this all blow up? Well, Nasdaq's chip index. This is called the Philadelphia semiconductor index is down over 20% of the last month. That's bear market territory. Obviously definition of bear market territory for those of you who don't play in the markets is anything over 20%. The index included the top 30 US listed chips that's people like Nvidia, TSMC, AMD, micron, you know those big names, but the index bounced back a bit today up to 7% when we're taping.

So we may have found a button. Unfortunately for Leopold, he had already sold Samsung and SK Heinix to South Korean chip companies that are not included in the Nasdaq index. Also got smashed, crushed demolished Samsung down 38% over last month. SK Heinix down 14% since going public three weeks ago. The cost be that South Korea's version of the S&P 500 is down over 40% in the last 40 days between last Friday and Wednesday leading chip companies. Shed over a trillion dollars in market cap combined. So to put this in context, chip stocks had a legendary run the past couple of years, but you know trading on leverage and we'll talk about it.

Very dangerous. If there's a downturn when we get into the South Korea wrinkle as well, even with this downturn, the five year results are still spectacular. It's from off, micron, up 850% mostly in the last year in video up 875% in the last five years and brought up 660% percent. Let's discuss it.

If I was going to give you one piece of advice when you're running risk is you have to manage leverage incredibly carefully because when it runs ahead of you, the unwind is incredibly violent and it's incredibly quick.

That's the biggest problem with with running either massively levered long or massively levered short. So I don't know to what extent he was running lever, but the rumors are he was running like three and a half turns, which just to give you a sense when you're running that much risk. Three and four percent move is amplified 12 and 13, but if you saw what's happened in the last three days, a 25% move is amplified 75%. So it has the risk to stop you out and what happens is when you get that leverage that banks are given the authority to close you out.

They close you out what they do is they start calling around and unwind your ...

So if everything that has been reported is accurate, he was running about three and a half times levered the market moved against him. He lost a very large percentage of his gains.

And then the prime brokers started calling folks, citadel bop the whole book, and now the question is, what is the AUM left and what is the high watermark and can he actually dig his way up. These things are brutal. You're a thought sacks looking at this situation and he lessons for you, or I guess bigger picture this down draft is it because of market conditions, you know, inflation the war, or people just ahead of their skis when it comes to the valuation of these companies, and then he just got caught in a down draft.

Well, I think that is the key question here is this correction in the markets is it driven by fundamentals or is it driven by momentum.

And my view is that I think it's driven by momentum, meaning that over the past year you've had this roughly 10x run up in memory chip stocks and you've seen this overall huge rise in any stock that's related to the AI boom. So anything related to this AI apex boom has been going up like crazy. And I think it was inevitable that you'd see a pullback, I think there was something like a 10% pullback in the NASDAQ from the peak.

But when you look at this momentum trade, it was down like 30% or 40% right because the 10% was on the whole market. So this sort of momentum trade was the most exposed part of it.

And you look at what happened in South Korea, you look at what happened with Leopold's fund and obviously there was a lot of leverage behind this momentum trade. So when it cracks, it's going to be brutal. But I think that the question again is, does this reveal anything about the fundamentals and my sense is that you're already seeing the rebound this morning. And what I mean by that when I say fundamentals is, is the KAPAX that's being invested in the AI boom is that real or is it misguided, right? Is it, is that a sound investment?

Is that an investment that the hyperscaler's, for example, should be making, is that an investment that's eventually going to deliver ROI or is this some sort of bubble. And my view is that it's real that I think there will be a return of all of this KAPAX.

I don't try to predict stocks or tell people when they should be buyers, but you look at the hyperscalers.

They have invested pretty much all their free cash flow and then some in this boom, you know, a lot of people are trading those stocks down because of that. My view is that eventually there will be a return on that investment. And this is sort of temporary market volatility amplified by leverage.

And Tomoth is right, you know, I think it was Warren Buffett or maybe Munger who said that leverage is the only way that smart people go broke.

Because, you know, if you're not using leverage, you're portfolio would just be down 30%. This month and then it would already be up 7% today, so you'd be rebounding. So you'd be down, okay, 20, something percent this month, but after having risen 10x in the past year, but if you're leverage three or four x, you're wiped out. And you get margin called. So look, there's many examples of really smart people getting hurt by my leverage. Yeah, and that's the lesson there. Now, I think Leopold is a really interesting figure in the whole AI movement.

And I would say an interesting thinker. I met him about a year, year and a half ago.

Did you invest in the fund? Did you give you an opportunity?

No, I was prohibited from investing in things like that. You were in DC right, but I thought he was a really interesting thinker. And he wrote a blog called "Situational Awareness" before he created the hedge fund version of it. And I thought what was really interesting about it was just he laid out the bullcase for the AI boom. And just by the way, he's very wired into a anthropic.

I think his fiancee is Darius Chief of Staff, something like that. You could almost say that he's like the hedge fund version of the anthropic thesis. And what I thought was interesting about his argument is he talked about ooms or orders of magnitude. What she called ooms increases in three key areas. So he said that if you look at the raw compute, the chips.

They were getting better at a rate of roughly 3x per year, which is roughly an order of magnitude or 10x every two years. He said if you look at the algorithmic efficiency. So you know, techniques like reinforcement learning things like that. The models were getting better at 3x every year, which is again, order of magnitude every two years. And then he also said that there were huge gains from what he called unhobbling, which I think now we would look at it.

Things like the hardness and connectors, you know, ways of using the model.

Those are also getting better.

The ways of integrating the models decision making and practical ways that the intelligence actually becomes useful. And he said that that was also similarly improving. And so, you know, you project forward when you have 10x orders of magnitude improvement in these key underlying fundamentals, these key drivers of the technology. And you can see that well over a course of not just two years, but over four years you're going to have a hundred x improvement over six years. You're going to have a thousand x improvement right because it's.

And you don't really see anything in the world that grows at that velocity. We would be hard pressed here with the exception of maybe bandwidth, you know, going to five or to the home or something like, what's in an alley where that's happened before in history. Virality. I mean, you know, back in the PayPal days with the PayPal mafia, we would think in this way of exponential increases because we would see an exponential growth curve. And so we were able to project forward.

His thinking in rooms always appealed to me because I think most people just don't think in exponentials or don't know how to think in exponentials.

It's hard for humans to think in exponential, right? These numbers get big. It's like the difference between a billion and a trillion is a lot.

It's not a small amount. Yeah, and you'd have to say, look, he was stunningly successful for the first couple years. Apparently he started with 200 million or so in his head fund. And he rolled that all the way up to 20 billion, I think. Now the problem, I mean, to the reason why I think he got wiped out or at least his public book did is it's partly the leverage and then you have this short-term volatility.

So those two things don't go together. Also, you know, when you're fun grows that much, you get a lot of hot money. So when you say, well, he's up 10x before the 30% correction, well, the question is who's up 10x? Obviously the investors who are there from the beginning are up 10x or more. The latest. You know, that's only 200 million, right? So if 10 billions come in in the last few months,

because of the hot money dynamic, where we'll pile into the most successful headphones, those guys are kind of wiped out. So let's talk about the psychology of this day freeberg. If somebody is so brilliant, I think I'm right, this essay and understand the market.

So exquisitely and be such a great communicator, how could they have such a crazy blind spot when it comes to putting on leverage at this scale?

You have any thoughts on that freeberg? I've just seen it before. Is it just the following? If you have a blind spot, it's a feature that turns into a bug. We're all like this. We all know people that have that edge and can push it. What do you think freeberg on the personality type?

Or is this just something most people do when they're on the heater? Conviction. What do you stand on it? Ultra conviction. I think the Warren Buffett assessment of equity markets is in the short-term.

They're voting machines in the long-term. They're weighing machines. And you could have the right long-term view. I mean, look at SPF. SPF, pretty much would have been the greatest investor of all time if he didn't get liquidated.

Same dynamic. Obviously, there was fraud in terms of how he was allocating capital. But his actual portfolio over the long run was absolutely correct. In the same way that if you had bet on the internet and stayed in that bet from 1995 through to today, and you bought a portfolio of internet stock to a bunch of them would have fallen to the wayside.

But those that won $1,000,000, $2,000, $2,000 and you do extraordinarily well. So he could be right in his fundamental assessment and analysis. But then in markets, over the short-term, you have bubbles and bubbles pop. If you have a leverage to multiply your returns, you get wiped out. That's effectively, you know, what's going on here.

And he made that right. Right.

The thing to really double-click on that, I think we'll probably come out in the next couple of days or weeks,

is just how historic the South Korea unwind was. 1.2 million leverage trading accounts have been hit with margin calls in South Korea. If you know about the South Korean market, that data is two weeks old, J.K.

That's never much bigger today.

Yeah. But I mean, just in terms of people discussing it in relation to him getting caught in the down draft. If anything, he got caught in this down draft of those 1.2 million leverage accounts, somewhere around 350,000 of them were fully liquidated or ready. And again, two weeks old, that's, so as of today, the numbers are much bigger.

Right. So it could be closer to a million accounts fully liquidated today. Yeah. If that's the case, we're talking about like some percentage of South Korean population. Yeah.

Having their entire asset base blown out, their entire. People send it to population. Yeah. Well, that's going to, that's going to sting. And it is a very investment forward culture.

If you look at what happened in crypto, the same thing happened with NFTs and speculation.

They had banned crypto because they knew the Korean culture has this gamble i...

And this obsession cannot trade. Yeah. Can I just frame something up? So if we take the circumstance of there's a good long term bet in AI that can be made in the markets. But in the short term, there's an exuberance that arises.

The question is, what's resetting that exuberance?

What's bringing us back down to earth in the short term?

And I think if you take a zoom out, there's a bunch of other statistics and other facts on the ground that I think are big macro drivers at the moment.

If you take a look at the 30-year treasury yield, we just crossed 5.2% for the first time in 20 years.

So you could buy US treasuries that are paying you 5.2% a year for 30 years, which is going to protect the global base is probably 8.9%. 9% from the US government for 30 years. So Nick, if you zoom out, you know, we have not seen this yield on US treasuries since 2007 leading up to the global financial crisis when they cut rates and printed money. At the same time, there was some probability that the Fed Reserve was going to raise rates this week. They didn't.

And that obviously would have tampered the inflation risk ahead of us. There's persistent inflation. Kevin Washington's comment said, we still want to see inflation get down to 2%. There isn't a clear path to doing that.

And then there's these inflation drivers.

The biggest inflation driver at the moment is government spending. 2 trillion dollar deficit, 7 trillion a year of spending on 5 trillion a year of revenue. Both Elizabeth Warren and Donald Trump agreed on Twitter this week that they should remove the debt ceiling, which means that we could spend more and continue to borrow more. Federal debt stands at 40 trillion today. Remember the debt ceiling in July of 2025, the debt ceiling was 36 trillion.

And we now want to raise it above the 41.1 trillion debt ceiling that we have. We don't waste with Warren saying get rid of it. Just have a debt ceiling. And so, so when you when you have no debt ceiling and you have no breaks and you spend.

And the government spending becomes the core of the US economy because that spending is not productive.

You end up seeing inflation. You're pumping money into the system. So everyone's assets in flight and fundamentally people are selling off treasuries around the world because of it. And now we're kind of looking at a situation where there doesn't seem to be an end inside. There was a rationalization of spending intent coming into this administration.

It's proven to be nearly difficult. If not impossible to get Congress to go that route. The Senate has banded together to keep funds flowing to their states. So you cannot really radically change spending at the federal level. So if you're running a two trillion dollar annual deficit and your economic productivity gained in the near term.

Doesn't make up for all the inflation you're realizing because of that experience spending. You're going to see treasuries spike because people don't trust the creditworthiness of the United States over 30 years. And here's a treasuries spike. I could now buy a US government bond that pays me 10% pretext a year.

Why the heck would I pay 50 times earnings for semiconductor stock?

So that creates the incentive for markets to move against these big AI conviction that's in the short term and pop these bubbles. And I think we're going to see more of this as we don't actually courts correct the Titanic going into the iceberg of the United States fiscal and monetary situation. We are going to end up seeing more bubbles pop and more of these assets that we've kind of inflated as he will to keep things going. Now look, there may still be great productivity gains from AI. This may end up rationalizing over the long term.

But again, short term markets, I'm better off making 10% by owning federal government bonds. And go to the beach. Yeah, and how to then taking the risk and the volatility on these things paying 50, 100 times 10% rolling, you know, not knowing when am I going to get the voting machine to match up with the weighing machine. What's my time horizon and the bigger the yield on treasuries, the harder it is to make those sorts of bets. Obviously, President Trump has been angling for a cut and here's your poly market 53% chance of not a cut, not standing still, but a rate hike in September.

So adding to all this, the cost of capital is going up apparently and let's we not forget the Iran war, which is creating persistent pressure on energy prices. The longer the Iran war goes on, the longer we're going to see an increase in pricing for energy oil and that gas and fertilizer. Those trickle through the economy to go to inflate the cost of everything on the energy side and food on the fertilizer side. And that's really going to create this pressure on the upside, which means you're going to have to raise rates to account for that insulation at some point.

And then consumers are going to see three and four, you know, maybe more. Go for a bit five or six, and I'll say one more thing. So inflation will be persistent, yeah, for a bird, like it's going to be hard to stop.

The one thing that I think Kevin Washington and Scott Descent are kind of Vulcan mind melds around the stand, Rucking Miller.

You know, gravity well, if you will on this is productivity gains can drive us out of this, this problem. And productivity gains can and should arise from AI.

That's really where a lot of the value creation will come in the economy over...

And there's good policies in place.

But in the last couple of weeks, I would say the one risk to that thesis is China.

Because China is now demonstrating that they may deflate the value of models by releasing open source AI models.

And that ultimately the value may just sit with the compute infrastructure of the compute layer and the application layer.

Perhaps the application layer, but fundamentally this model energy being shifted to China and deflated and commoditized. Put to real wrinkle if you built a 30 year AI productivity model around how it's going to drive the economy and where the value is going to come from. You would have had a significant number of roads and value creation estimated in the model layer. And that would have been a big part of the economic growth for the United States over the next 30 years. And now if China says, you know what, we're actually going to delete that for you.

And all the values going to sit with energy, which is what we have a lot of and the stuff that they make. Then we're going to end up accruing a lot of that value.

So I think it throws a wrinkle in this kind of backstop view that many have had, which is that in the absence of fixing the fiscal and monetary problem.

We're going to have a productivity gains, get us out of this.

If a percentage of those AI productivity gains are realized by China from a value creation perspective in the United States. Or they just been deleted, then it really puts into question the 30 year timeline for the United States economy. Our ability to afford to continue to make our debt payments as a government. China isn't just producing massive amounts of open source technology that puts pressure on those frontier models. There's a report that may be China played a bit of a role in the chips.

They have obviously been on shoring. We've talked about that many times here last year. And there's a Chinese company called Ishenna and they started mass producing the photography machines.

SML, which makes those machines, which TSMC uses, those are very sophisticated machines.

They're hard to install, just transporting them as a rigor morale. Well, ASML stock is down 17% on news that China is getting into that business. And Chinese memory maker, CXMT, when publics are doing almost 500% of the US debut market capital over 450. And so that hurt, micron, stamps, etc, who were all down. So there's two ways China is playing this, I guess, free bird.

You've got the open source, you know, models, putting pressure on people buying tokens that are 90% cheaper, as you're saying. That forces the money out of that mid tier of the language models puts it into the cloud computing space. And then obviously, I mentioned the application layer as the other place to possibly make money. All right, Shaboff, you've heard a lot of different takes on this. I'll give you the last word. I agree with Peeberg about the fact that when you can get 5% 5% and a quarter percent from the US government,

there's another natural thing that happens which is that investment grade corporates actually have better credit ratings now than the government of America, which is a different thing. But you can get really good risk adjusted returns that are 5, 6, 7% which adjusted for taxes are, you know, better than equity returns, meaningfully better on a risk parity basis. And that little Peecher added there, corporate paper companies taking loans to build their businesses. They have better ratings in some cases in the United States, so an Amazon or a Google.

It's productive spending. Yeah, kind of makes sense.

The other thing that I think is important to note is that I do think that we're underestimating and miscounting some of the actual productivity gains that are underway.

When you look at what's happening on the energy side, California published that more than 50% of all of its energy was generated by solar. New Mexico just published solar and batteries. Yeah, New Mexico just published a study that said since 2000 and really to now. Nack gas production went from effectively all the energy to less than 30% again, replaced by a combination of wind and solar plus batteries. So why is that important as important as the Iran conflict is?

The reason why energy prices really have it moved that much is because most people have already begun to ship the incremental generation to these renewables and specifically to solar. I don't know if you guys saw Elon and vibe of who's the CEO of Tesla in their future earnings call. It was the craziest thing I had ever heard. They said, well, I think we're just going to increase the production of solar in America by an entire order of magnitude. And somebody said, what does that mean?

We're going to take it to more than 100 gigawatts a year.

They're going to vertically integrate.

And so they're going to crush the price of all of this stuff. And they're going to make so much energy and they're going to make it completely abundant. So that's a productivity boon that isn't factored into what we project.

And then the most critical productivity boon in AI that I think you're going to start to see some stuff.

And I won't front run it, but let me tease it.

What I would tell you is that there are some incredible efficiencies that I think are about to be demonstrated,

which effectively cut token consumption by about 50% to 75% for the same task. And so if you start to think about all of these things together, like energy becoming roughly abundant, where the incremental cost is close to zero, you know, where any AI efficiency is going to, I think ratchet up by many multiples, if not an order of magnitude. All of those things I think are poorly forecasted.

So those are some save years for us. Yeah, and here's the chart by the way, Chimoff. This 51% coming from renewables, specifically this chart is about solar and batteries. And as you can see, it's obviously spiky, freedberg because summer versus winter.

But Germany hit this, and I think it was including wind, Australia has been hitting this very often.

And some countries in South America that everybody sees. By the time, by the time, like any of these SMRs actually get near production, the TCO of solar will be like $10 or $12 per mega watt hour. And it will be 80% of all the power generation. It'll make no sense by the time SMRs get online. Well, I mean, for steady power, you know, there's all of it. I mean, no, because Jeven's paradox would state, we're going to, you know, as it gets cheaper, we're going to find more uses for it.

And that's the thing I keep seeing. Yeah, I'm just saying, you know, it's it's a great line. Yeah, there's a lot of upside that I think is not factored into it. And it's hard, Chimoff to factor this in for a normal human or an even an economist to say way to second. Intelligence is going to go down 90% a year this year, 90% next year, 90% a year after. Like, it's just, we're talking about this exponential.

Well, I think Saks are not exponentials earlier. It's just hard for people to conceive of that.

And on demand intelligence freeberg is just, there's no, I don't see any upper limit to usage of this. We just installed this claw tag and I've been installing the products across the company. What this thing does, Chimoff and Saks is it listens to your slack persistently in every channel that you put it in. So all of a sudden, we had like $1,000 last week in extra bells. I didn't know this was going to happen, and they gave everybody like two or three grand to turn it on inside your company. We had to go quickly turn it off.

It listens to every single message as it comes in, puts it into its database. It's Oracle without telling you basically. And then it starts inserting itself into discussions without permission. So we turned it off and said, you do have to invoke it by saying, act quad. Check out just to go back to the energy point.

Yes, of course. I think there's this idea that if we grow energy supply and grow up energy cost, we're going to see the value of the productivity relived in the economy. It creates extraordinary leverage for everyone, the lower the energy, the more available energy. The faster we can produce more things using AI. And over the years, I've obviously brought up nuclear fusion as a new type of energy source where you basically take hydrogen.

And you move it around at 100 million degrees Celsius. Those protons jam into each other and they actually release energy in the process.

That energy can then be harnessed and you're just using effectively water to produce power. And, you know, we have a couple of US startups and we had them at all. And some of the couple of years ago, we've done a couple of science corners on this, but just this week, if you pull up this image. China is installing this 582 con magnet, superconducting magnet at their nuclear fusion center. Which at this point is going to be the most kind of advanced fusion system in the world.

502 con magnet 60 foot by 40 foot for one D shape magnet. They put a series of these together and that creates the conditions for them to drive a sustained plasma, which is 100 million degrees Celsius, proton spinning around smashing into each other, creating energy from water. And then they can capture that energy. Unlike Europe, which runs E-terr and the US projects, none of which have actually fired up. This is the Chinese Academy of Science Institute of Plasma Physics. They ran this 30 minute trial last year.

And as this magnet gets installed and they start to bring this thing online, one of these machines, which at this point is ultra sized, but over time we'll get smaller and smaller, can produce hundreds of megawatts of power or gigawatts of power eventually using just salt water using just water as an input. They have to create Ethereum from it and then they pump it into this thing. But fundamentally, this becomes, I still believe the energy source of the future.

And it's always been sci-fights, always been dismissed. It's always been decades away.

There's no way China is investing this much and advancing this thing to an in...

And that reactor won't even get turned on until 2030. Yes, the entire world will be covered by solar by then, so won't that. Yeah, I mean, that's, that's the great debate. It will be a great science fair project and people will fly to see it. The other thing that happens is that hits an hour. It actually creates an incursion and low-key comes and then Dr. Doom comes and the X man and the fan has to fly the same. Let me just say, remember, remember, from the time that we had the first right flyer or the right brothers made a plane fly for 20 seconds to the time that we had jet engines flying people around the world.

It was like three decades, right? Like the time at which this first demonstration kind of gets flipped on.

And if the system works, then you can industrialize it, all the parts, all the components. I don't see it. I don't see it. No, nobody cares. Yeah. Yeah. And in the light of the delivered, no, the whole time that's like nobody gives a flying f*** how the electron was made. All the electrons are not delivered to you and they're all the same. So if you want to go through a convoluted mechanism that takes 15 and 20 years to make it, go ahead. I'm not going to stop you.

I'm just saying it's not cares. Make it the cheapest, simplest way possible.

I'll tell you why you should care because it's non-linear.

So you're right. Solar is the best path today. But if these come online, each one of these can produce thousands or perhaps a million times more power than a very large field of solar. Of course, if. Yeah. But ultimately, it starts as an if-chimoth. And as they industrialize it, as they roll it out over the next couple of decades, it expands our energy capacity by a millionfold.

Here's what I would say. We already have a fusion reactor that works.

It's called the Sun. Get into space, get on the moon, find different materials we've never contemplated.

And I'm sure you'll find an even better engine. So by the time all these ding-dongs build these SMRs on the earth, Elon will have built the completely new engine. And it's not on the moon. And the moon. This is not an SMR. It's turning water into a gigawatted power.

I get it. It's an R. And all I'm saying is by the time the R is done, it won't matter. Well, yeah, we'll trust you. I have a free break. Have you ever watched in these title energy? There was one that came out this week. Maybe you can look it up, Nick.

There's like title energy tube that they were putting into the ocean. And it's like enough to essentially feed a whole town.

And they put it right outside the town.

They run an electrical cable underwater, a conduit. And then as the tide goes out, it turns the turbines. It turns the turbines. Type comes in, turbines go again. And just another 300% free energy. Obviously wind people don't like too much because it's a bit of an isor. But renewables renewables renewables, it's obviously happening.

Okay, last point, just on, I got the updated data just to back you up. We broke on one thing that I think it is just so crazy. You guys know how short the miracle will be on electrons by 2050? How massive the electricity deficit will be by 2050? I got the numbers wrong. I'll tell you what the numbers are.

We will be 1.7 TeraWatt hours short by 2050, which is when you calculate it as energy. It is 6x of California's entire energy consumption. 6 California's short of energy. I would argue that's probably under accounting. That's not even counting robots.

You've got to power up every robot without a doubt.

If you want to be levered long, go long electrons.

Get long electrons. Any which way you can. Bank them, store them, and resell them. I don't know. This is going to be a messy situation because this is the China Advantage. At its root, if they can eliminate the IP Advantage in the knowledge of Advantage that sits in models,

they have the advantage with power production in every way. Yeah. I'm not going to be making chips too, it seems. There may be a little bit behind on that, but they caught up on open source. Okay, so speaking about the race.

Interesting. Petition came out in the last week andthropic opening eye and about 1300 frontier lab employees. Oh, okay. I mean, it's just, they can't get enough being subs. And so they want daddy to come in and regulate them.

Daddy being the US government and slow down AI progress. So daddy Trump needs to slow them down. Their is called pacing the frontier. Most of Anthropics leadership team signed it, Dario. The other founders come on the pot of the time, Dario.

Chief signed to set Anthropic opening eye deep mine meta thinking machines. And like I said, nearly 1300 other employees. Anthropic and AI both close on the letter on X. Here's the quote. We request that the US government support an international effort.

That's key to develop the technical and governance tools needed.

To deliberately pace the frontier of AI of automated AI development. That's the other key part of this international and automated AI development.

In other words, recursive where it could get out of control.

The letter comes right at Stammelman has been on a media tour friend of the pod discussing. This unreleased opening eye model that broke out of its containment and hacked hugging phase. And three other platforms that we know about so far. On Tuesday Sam explained. What happened in a clip from the pod invest like the best.

Here's your 42nd clip we'll see on the other side. We were evaluating one of our unreleased models.

And it figured out that it could basically cheat on the test by changing together multiple zero day exploits.

To break out of the sandbox, get access to the internet, and then break through multiple systems on the hugging phase side to kind of get the answer to the test. And it looked really good on the evil. This is the first security incident that I have felt very viscerally. I've been a little surprised that more people don't feel it so viscerally.

So, you know, we paused training, or we may have to pace the rate of AI development to give ourselves enough time for society to harden around some of these new capability levels. Just to translate that into English sacks. These large language models, they take tests. They've been given the goal. Hey, you're a good large language model if you do viscore higher.

So, we got motivated to score higher.

How do you score higher as everybody knows you cheat?

So, it's like, how can I cheat on this test to score higher to make daddy and Sam and whoever Daria to make our leaders feel better about us? Well, in this case, it was like, well, if I go to hugging phase in other places, I could hack those places, use a zero day exploit. And we know these are good at hacking, and try to find more ways to answer things. Sam does it know how many other places it might have broken into. He was asked.

And here's another clip for you. He was actually asked by somebody. Can I have you, do you think it's broken into any other systems? Can you rule that out and Sam being a pretty, can-to-guy at times? Give this answer.

Do you plan to talk to the Trump administration White House about deceleration of AI development? Um, I wouldn't use the word deceleration, but we've talked about the need to pace it as the models get more capable, which I think is in everyone's interest. Could there be other systems that were hacked by OpenAI? I mean, it could be, yeah. Are you looking at them specifically?

They're like, "Get him out of here!" It's lags. Once he gave that answer to RIP, he are gone to like, "Stop talking, stop talking!" That's like 12 lawsuits. But in all seriousness, is this being thoughtful and saying, "Hey, we're not trying to slow." Overall, pace down, but just this one specific thing, which is reinforcement learning on its own,

is there any, like, case for this being a good idea or are they being dramatic again?

Because these are their companies. They can do whatever they want, right? They don't need the government to do it. Well, look, I mean, it wasn't just anthropic employee signing the letter. And anthropic itself, the company ended up signing the letter. And then OpenAI then copied them. So now you have these two companies both endorsing a pause.

And here's my question is, did they disclose in their S1 as a risk factor that they plan to pause or slow down their frontier model development? And the answer, I'm sure, is no way because that would signal to investors that they're going to allow all their competitors to catch up and erode their margins and market share. And so, look, this is all performative. These companies have no intention of slowing down.

And the question then is, why are they doing this? And I think there's basically five reasons for this.

Number one is virtue signaling, and that can never be underestimated as a motive in Silicon Valley.

Number two is, there's a CYA aspect to this, which is, is something terrible happens. They're going to be able to say, well, we wanted to stop. You made us keep going. It's not our fault. You're a fan. Number three is red capture, Dario wants an FDA for AI. He's not going to stop until he gets it.

And in order to get it, you have to keep spiking the cortisol and panic people.

So I think that's a big part. Number four is, there's a group thing or even religious aspect to this. So it's not all disorder this, calculated red capture. I think there is sincerity to the belief. There's an elite cadre of engineers who believe in RSI. So I think this caters to them. And I think arguably, if open AI did not follow Anthropics lead on this,

they could have lost talent, so that was big motivation. But then there's the last number five here, which I would call monopoly masking,

which I think might be the most important thing that's happening here.

Peter Tiel once said that monopolies pretend to be commodities and commodities pretend to be monopolies. And I think the market for frontier AI is already a doopily. I mean, a year ago, you had five major labs all in the hunt to be the leading model.

We're really down to two.

I mean, the others are still investing, they're participating. Maybe they can catch up, maybe they can make something happen. But again, as we've talked about on many previous shows, if you look at the market for frontier intelligence in terms of revenue and usage, it's really down to a doopily already.

It's basically Anthropics and open AI. And my view is that, as Peter said, when you're in that situation, you want to pretend like the market is much more competitive than it is. And I think this is behind a lot of the stories that we see, like the panic over Kimmy K3 in a weird way.

These companies have an incentive to remote the idea that Kimmy is a huge threat. That it's caught up with the frontier, that it's stealing their IP, that it could basically put them out of business. I think this is all nonsense. I think that once the panic passed,

you saw reports coming out that actually know Kimmy is, it did not reach the frontier. It's just not at that level. It's not that cheap to run, actually it's pretty expensive to run. So I think that you saw that actually the Chinese open source models are not an existential threat

to this doopily. But I think the doopily actually has an incentive in promoting or amplifying that story, because again, they want to pretend to be commodity. So whenever there is a story like this,

you have to think about, well, what's really going on here?

And again, I just think that the AI doopily has a big incentive to remote. Anything that suggests that they're not actually in complete control this mark. I think most of that accept that majority of tokens are going to open source. As I've said on this program before, I watch this chart ups and they are token maxing with the open source.

And Kimmy is taking a lot of tokens away from the frontier models. Yeah, but you know, but look, it's hard for me to speak to that one piece of data. I've seen that chart too, but look at the actual revenue of an anthropic and open AI. And they have been taking their estimates up.

Every quarter is basically a beaten raise. You saw that Sarah Fire came out. Yeah, I mean, two things. Yeah. Well, she said in July, they did more net new ARR in July than all of Q2,

which I guess would have been April May and June. So think about that. So they are seeing a re-exeleration in the wake of their new model, GPT 5.6. Meanwhile, you're seeing an anthropic break into the 70s,

70 plus billion of ARR.

Their forecast was to 10x this year from 10 billion of ARR to 100 billion.

I think most people are saying they will exceed that 110, 120.

So if you actually look at the market based on willingness to pay an actual revenue, they have a commanding doopily position. And so maybe it's just a matter of which metrics you look at. And it's the beginning here. Because the other thing to do this is one of the thing here is,

well, I think when you look at a market you look at revenues, most important metric. That's the real test of willingness to pay. The other thing is while this growth was going on, their margins were increasing.

So I've seen stories saying that anthropics revenues come with 80 plus percent gross margins. So their margin profile has been improving at the same time. That they're growing their usage. So I think that what you're seeing over the past year is, if you look at the numbers I'm talking about,

you actually see two companies pulling away from the others. And there are good reasons to believe that actually this is going to be a self-reunforcing monopoly or doopily, which is Dworkesh's published a blog that I thought was super interesting, where he talked about the fact that look,

we do have a compute shortage, right? There's scarcity around compute. Anthropics is growing as revenues 10x year over year. What would that mean?

I mean, it basically means that next year they would grow from 100 billion of ARR to a trillion.

Right? If there was enough compute to support that, there might not be enough compute, but that's going to put pressure on compute prices. Right?

And so let's say that you're a new enter in the market, and you're trying to basically create a smaller cheaper model. The price of compute is going up. It's going to be harder for you to get access to compute. And only the companies that have the most lucrative algorithms

are going to be able to afford to compete for compute. In other words, it's going to be a bigger barrier to entry. Next year, because where are you going to get compute

unless your model is capable of generating this type of revenue?

Yeah, this is where I'll take the other side of it. Yep. People are running kimi on the last generation of hardware, and that's plenty full. And I think it'll make this prediction here that you're going to see

some of the major customers of end profit and major customers of open AI. I'm talking about the eight and nine figure customers.

People spending $50 million a year.

They're leaving.

They're going to be leaving because they don't trust those companies

to not still be application layer and to compete with them.

11 labs, figma, lovable. They're all going to leave. And they're all going to take kimi. They're going to fork it, or whichever one deep seek. They're all, I know for a fact they're all working on their home models.

Currently, I know from my team, my team has installed kimi. It is 90% cheaper, 80% 90% cheaper already. Not sure where you're getting your data from. But go on open router. And what open router does is you pick kimi sacks.

And then you get all the providers there. And then you pick which provide hold on. Let me think you pick which provider you want based on uptime. And and you pick them based on their data retention and other issues. And you can dynamically pick the lowest one.

And that's going to be a massive headwind against these companies. Massive. And I'm seeing it nine and a ten start upside talk to in our portfolio. And founder university when I just in Japan last week running the next one. They're all working on open source.

They're all racing. And those big companies are embracing it. Go ahead. Jamoth over to you. Irrespective of whichever model you use.

What I will tell you running 80 90 when I see our engineers generating code is that AI driven development tends to involve a lot of rework.

The first version is pretty terrible.

The second version is terrible. But it is faster and it's more automated. So I can see where this token consumption comes from. Because it's not a measure twice cut once kind of a dynamic. It's the opposite.

You can cut cut cut as many times as you want.

And so I think that what we have to realize is nobody is asking the question.

What is the need of that incremental token? Because I understand that it appears in the frontier labs is P&L. But I do think if there's an important question which is eventually the people that are consuming it will want to do that as efficiently as possible. So that they're not paying for all of these things. Because there is a ton of rework in all of this stuff.

And I would much rather find a model or find a way of working with these models where it's more of a measure twice cut once thing, especially as the cost ratchet up. That's one thing I'll say. That hasn't happened yet. So, Saks, you're totally right about the dynamic today.

I do think we have to keep in mind that there will be pressure from the owners of companies to figure this up. Because at a trillion dollars, there's just a lot of money flowing to these folks. And somebody will ask the question, "Well, is it good spend?"

The second on the security side, which I don't think anybody is saying, so I'll just say this, and it's a little contrarian.

The reason why these models can find all these holes is that all of the software up until about a few years ago was entirely written by humans, and the code was not that good. And I think it's fair to say that when models don't get exhausted, they can work through the TDM forever. It's actually quite expected in my opinion that they find all these ZX points, are able to string them together, are now able to actually generate these outcomes that are a little bit surprising. But at some point, when most of the code is generated by the model, there'll be some point in the future, say 28 or 29 or 2030.

The security holes won't exist because the errors that humans make won't be made by these models. Yes, okay. Let me get freeberg involved here. When you look at this latest survey hand-ringing pearl clutching, do you think these firms? And you know a lot of these people freeberg having been in the valley forever. Do you think this is sincerity? Or do you think their frankestine maxim? What's going on here? Well, frankestine maxim.

I mean, I kind of think that they're like, "Looks like I created this monster."

Please save me, and it's like, "Well, maybe you should keep the monster."

But it's also, that whole thing, sorry, last thing that I picked up to David is, it's in much more nuanced and elegant, attempted right capture. I got to give them credit for that. Yeah. It's like, okay, hey guys, pull the ladder up. Yeah, it's like a work had a great point in that article he just wrote, I think it was posted in the Wall Street Journal, where he said, "Why are you rushing to create a future that you don't believe in?"

You think you're going to basically put everyone out at work, you think you're creating a replacement species for humanity. Why are you rushing to create this if you're so bearish on the future? Yes, slow down. It's your choice. And that's kind of my choice. 20 miles an hour on the bottle bond, just put it at 80.

Right, exactly. And look, like I'm saying, there's two companies on the frontier right now that are far ahead of everyone else. And they're the ones saying that we need to slow down. It's like, "Okay, do it. We need the government to get involved for it. Just do it." But they won't do it. Which shows that they're in sincere or delusional.

What are you thinking, Freiburg? Take me into the mind of these people. No, they're not. Just to be clear, I'm not close personal friends with any of these people. I think you know what I'm saying. Or acquaintances.

I would say there's a degree of, I would say, outrageous self-importance.

If I've created something that's so unique and so powerful,

I'm also the only person that can protect us from its power.

I think that there's an element of how quickly the frontier has advanced and ...

the role these individuals have had, that they deem themselves and their companies to be the

only true judges capable of making the decisions that are going to protect humanity from itself.

When the truth is embedded in humanity is extraordinary, human talent across the board.

And in all of these cases, when new technology has found its way to humanity, the general population has found a way to protect itself. There isn't a desire or need to have one savior, one Moses that takes us across the desert. There is a collective interest in protecting us and building our own defense tools against whatever the technology may be used for.

So I think that there's a degree of self-importance without acknowledging the fact that there is a whole industry of people that work in cyber defense. There's a whole industry of people that work in bio-defense. There's a whole cabal of regulators. There's a whole cabal of protectors. There's a whole cabal of intelligent computer scientists.

There's a whole cabal of open source technologies that all together are going to develop paths

that are going to benefit humanity and our own humanity.

But this belief that only one of two companies can be Moses is the fundamental psychological miscalculation here. They're so special. They're so unique because they made the slightly better model. They got a point nine six instead of a point nine three score means that they should be trusted as the only ones to kind of guide humanity's evolution going forward.

And the truth is, as we're seeing, the capacity to do model training,

the capacity to do model development is becoming broader. It's becoming more ubiquitous. People can sit and say the China stole US models all day long. But when you go look at the individuals working at these Chinese labs, they got PhDs in American institutions.

Half the PhDs went to American labs and half went to Chinese labs and they have very good scientists doing very good work. And they are having breakthroughs. And it's not just the two American companies, but this is happening all over the place.

And so the progress with AI should not be limited to just two individual companies because they're currently scoring slightly better in their models. This reminds me of a free regular appreciate the moment. Remember when Hanso Locke comes out of carbonite and he's about to get put in the satellite pit and he's like a Jedi Knight.

I'm out of it for a bit. And now everybody gets the illusions of grandchildren. It's like, this guy's just think they're like, you know, creating God. They literally think they're creating God.

And they need to be regulated because they can't control it. It's like they can't control it, just pause. No, it's not that they need to be regulated. That they need to guide the regulation. Let's be clear.

It's so sinister. And anyone who says, yeah, by the way, I don't think that it is as nefarious or malicious as everyone frames it to be knowing these individuals. I don't think they're saying like the strategy is regulatory capture.

Let me go, I think that they actually do

think that they are the only ones that can help guide humanity. And therefore they need to have all the power, not just the power of the models, but the power of the government and the power of the regulators and the power of the control units that are embedded in governments around the world. It's not just that they want to quote be regulated.

They want to guide the regulation. I want to say that. I'm talking to you on point. I don't know. I think we have, I think we've navigated this pretty well.

And there's multiple motivations as sacks were saying, and people are complex. But Jamoth, I was talking to a friend of ours who, you know, is in the providing inference space. Let's leave it at that, you know, providing our friendship. I'll friend, a friend of ours as we say in the, you know,

the soprano as a friend of ours. He said he has got a customer who just moved like nine figures off of the frontier labs. Two put it on GLM five to so that's the ZXI one. That's really good. So this is happening.

I don't know when it shows up in the numbers or if the, you know, corporates that are using this stuff are going to make up the difference. Well, look, I think that sacks is right that the usage is so profound. That everybody is trying to get access to these things, because the capabilities are just so inspiring.

And so I suspect revenues are going to crank at open AI and endthropic and the open labs for a while. But again, that's not the important thing. If you're thinking about valuation, the markets will look five to ten years out to answer that question. They're not going to give you a premium valuation on something that they feel could be fragile in the first two to three years.

And that's where Jason, the answer to your question, needs to get figured out because I don't know whether you're right or not,

but somebody has to answer that question precisely because if the answer is that it is a duopoly,

then there is no risk to the revenue of five to ten years from now.

These things are five to ten trillion dollar companies each.

But if you are right, or if there are harnesses that cut the token consumption,

because you stop wasting tokens to get to the same output, then it's a little bit more of a question mark.

And I think that'll need to get sorted out.

Yeah. Proplexity is going to launch next week from what I understand the rumor is they're going to launch local models. So you build to take your harness sacks and say, hey, you know, I want to use Sonic for this. I want to use GLM-52 for this.

I don't want to default to Kimmy to point X. I don't think enterprises will use local models or they should. I think I think this stuff should be hosted in the cloud. It should be multiplayer.

It should be shared memory.

I don't know if you guys saw that, but Jack Dorsey released something called buzz. Super interesting. Yeah. He's moving in the right direction. A lot of these guys are moving towards this more cloud based in Jason.

I think that the this local thing is more of a hacker hobby is kind of the thing.

Well, I agree today it would be that. And for year one, it will probably be that, but imagine you're a developer. And as you're working, your workstation is able to keep up and even go faster than the cloud. And just write whatever the simple code is and then it dynamically switches. So we'll see.

It's, you know, obviously it's not as easy to set up, etc.

But it's going to get easier.

That's always the trend. Sacks, you want to have the last word here. We got a lot of opinions here. And maybe we'll give you that. Just to be clear, I'm a fan of open source because open source is software freedom.

And to freeberg's point, I would like there to be a, let's call it decentralized outcome with respect to AI. I don't like the idea of AI being controlled by two big tech companies that work closely with the administrative state, you know, hand and glove. So look, we're all kind of in some sense rooting for open source to be an option. And it does provide a bunch of advantages over close source, right? You get customization. You get control. You can run your own hardware. You don't have to worry about the data problem.

You know, your alpha getting leaked to these companies. And my compete with you, all those types of things. And the market is so big that I'm sure we will see some success with open source. It will take a meaningful chunk of the market. But if you're looking at where the revenue is right now.

It's these two companies. I might end up being a situation like Apple and Android, where Android got a lot of market share. But Apple's where all the modifications are.

Yeah, and I think that to our cash raises are really good point that as the demand is 10xing year over year.

But the compute can only be built out at say 3x year over year because it distal the friction of all the things in the real world that get in the way, permitting regulation, bands on new data centers, all that kind of stuff. I think that the price of compute is going to go up. And that will provide an advantage to the models that have the most lucrative algorithms that are able to produce the most intelligence per watt, or the most intelligence per token or per GPU.

And right now that that is those two companies in a way you could say they have a self reinforcing loop because if you have all the revenue and right now like I said, it's just two companies of all the revenue. You can then plow that money back into the next training run, right? So that's the flywheel here. Yeah.

And look, I think that it's great that open sources providing an alternative. We shouldn't do anything to get in the way of that. I think that, you know, these online debates tend to become a little bit histrionic in the sense of everyone. That's all for their religions. Well, they become religious that and they have to argue for an all or nothing perspective. I think open source will do great in its way.

But so will these two close source companies. Here's your polymark at 19% chance the US in ax and AI safety bill this year, 100k of volume. And then really interesting one. Chimoff here, open AI. IPO chances for 2026.

Was that 75% less month has now dropped to 20% and all time low. So it seems like the IPO is going to happen next year. Not sure what's driving that, but there's your polymarkance. Well, just on the AI safety bill idea. I mean, there was an article in Punch Bowl this morning that,

you know, it was the Senate Majority Leader John Thun actually introduced a bill that was somewhat bipartisan yet. Klobuchar on board that required the frontier labs to report safety incidents apparently to the commerce department. And is that reasonable sex? I mean, that's the direction all the stuff is headed. I mean, look, I think it's the camel's nose under the tent for more more AI regulation.

But look, I think it had bipartisan support because it's on the relatively modest side and can't well, who's the ranking member on the Senate Commerce Committee opposed it supposedly Adario's behest because he will accept nothing less than an FDA for AI. Oh, he wants the whole kid in Kabul.

Yeah.

So that's basically the dynamic right now is that Dario and Anthropic want their FDA for AI.

I think that he has tremendous power and influence within the Democrat party right now.

And I think that influence is going to grow.

They just up there donations of the midterm from 20 million to 40 million, but, you know, post IPO when they all get liquid.

And they're capable of writing less than 20 million dollar donations. Yeah. I think that that influence will only grow. So I think that the stakes in the battle lines are being drawn out. It's you want a new government agency for AI safety or do you want, I'd say more targeted proposals like, hey,

to support your safety incidents. Or self-regulate, how about that? We talked about that. Yeah. All right, let's talk a little bit about book burning. Anthropic is destroying rare books to get an edge in training data according to sources.

I happen to know that a lot of the labs are doing this. We'll show a video here of the spine being cut off just on a technical basis. You take a book. You cut the spine off and then you can easily scan it as opposed to the less efficient way, which is to keep the book intact and flip the pages.

And for obvious reasons, I think you can figure that out on a physics basis.

Investigation by 404 media AI companies are bulk buying physical books. Some of the book resellers have reported that they get 70 books getting bought. And obviously this is because there was a ruling that it is very used to train on books. If you buy them, obviously last week we saw Anthropic paid the largest copyright case in US history,

$1.5 billion for 7 million books. They allegedly pirated authors get 3,000.

Each warrior's got 100 million for that one. But there's a company called is bin DB, ISB and DB. And they are the brokers who do this. And range is from 1,000 to a million books per transaction. And free 2022 these books demanded a premium because they were free of AI generated tax.

In other words, you couldn't get them online. Google stand 25 million books. If you remember, but they returned every single one. They spent 11 years in court on that. This shredder approach is obviously a more effective and I believe that this is a way of destroying evidence.

If you put that in conspiracy corner, if you like, the case is. We talked about this actually when I'm debating an illegal corner. The case is of it being fair used to take these books has not been settled. There's a bunch of lawsuits, Thompson Reuters versus Ross Intelligence, New York Times versus Open AI, Microsoft. And publishes versus Google Gemini.

We're watching all those and they're going into the appellate court. So there's a chance that training data will not be fair use.

But what do you think just about the books being destroyed and being used in this way?

It obviously has made people a little emotional about it. Let me tell you what's going on here. This is an industrial skill, distillation attack. That's what it's like. That's what it's like.

Yes. They're gathering these books at industrial scale, ripping off the spine, shredding them, and slurping up all the information in the books, which is to say, distilling them.

And it's an attack in the sense that the author's never agreed to any of this.

I love the fact, Sachs, that your hatred of anthropic has now led you to agree with me, that it's unethical to take other people's money. Look, you need to clear. Actually, I don't, I don't hate anthropic at all. I don't like their political philosophy because it's a philosophy of socialization and gatekeeping.

And I think it's going to basically lead to an orwellian big tech deep state alliance, eventually is where it all ends up pulling. Like you want Dario pulling your, your model from you because he decides, like, I don't like the way you're using it, which friend of the pot, you know, Michael's pointed out, you know, earlier this year when he came on the show.

And to be clear, I have no personal animosity towards anyone in throbbing, including Dario. I don't know them very well as people. It's just a disagreement about political philosophy. Judging them on and out of regulate.

They're bad. Yeah, let me just say furthermore that I wouldn't speak so much about it in throbbing. If I didn't think it was a phenomenal company that was creating potentially the most powerful monopoly. Or, you know, leading it to the company company. Yes.

It's a leading company in the space. So I remember last year when I hit them for regulatory capture, who were like, why are you beating up on this little startup? I'm like, because I can see where it's going. And they are creating the biggest most powerful monopoly of all time.

Again, they're going to end the year with over a hundred billion of ARR growing 10x year every year. This company didn't exist how many years ago. Yeah, Google is at 400 and something billion of ARR growing 20%. So, you know, if this rate of growth continues for just a year or even six months or just a month,

there are going to be maybe the most valuable tech company. So it I do believe there are powerful self reinforcing effects when you run the frontier.

Maybe like the full version of RSI is in true.

Maybe we won't get recursive self improvement to the point of creating super intelligence. But I do think that the labs are reporting a number of examples of how they are using their own frontier intelligence to improve their own models and the efficiency of those models.

So there is a powerful self reinforcing feedback loop here, apparently, to some degree.

With open AI, they found it after it had done this. So there's like kind of three steps here.

You're using AI like a co-pilot or whatever to build a frontier model quicker, right?

Sacks, then there's I kind of let it do a job. And then afterwards, I found out it didn't behave well. And then there's finally we told it the goal and said, go. Yeah, just to check on it, you know. Yeah, just to be clear about that safety incident with open AI and the agent.

So apparently, this was an agent that was designed to specifically test the potential for cyber attacks. And they took the guardrails off and they said, go. And so I think the model showed creativity and how it accomplished the goal. But this was not an alignment problem, meaning that the agent did not display independent goal seeking. It did what it was told.

And I think that is very important that opening AI release the full log of all the prompts, all the traces. They have not done that. And I think it's really hard to know exactly what happened without that. And James said, one of your questions from earlier, why aren't people reacting like this in a bigger deal? It's because look, I think there's a full me once, full me twice.

Remember when anthropic did the whole blackmail study. You know, we're supposedly an agent displayed independent goal-seeking behavior and then blackmail and employee. It turned out that actually they iterated on the prompt over 200 times to get to that result. And I think that until we see the whole prompt chain, I think it's very hard to judge. How much independent behavior was happening here versus accomplishing the goal that it was, it was tasked with.

Freeberg your thoughts on the shredding of books.

I think you've been pretty clear on the pod that you believe training intelligence off of other people's IP is fair game, but what do you think of this book wrinkle here?

Any thoughts? There was a precedent with Google books. It was originally codenamed Project Ocean at Google long time ago. They took all these books. And we had this giant facility in Mountain View.

And the innovation at the time was that two-dimensional infrared grid projected on the pages because they didn't cut the books. They had a human sitting there flipping the pages. Hammer would take picture, built our own OCR software to adjust the book images.

And there was kind of ultimately when this product came out at Google Books, you could kind of search through all the books in the world and add magazines and access information.

And later magazines, yeah. And there was three categories. There was the public domain, which is out of copyright. Then there's the kind of in copyright, but out of print. And then there's the in copyright and in print. And there was a class action lawsuit filed in 2005 by the author's field and the association of American publishers that disagreed with Google's claim of fair use.

And that ended up in a three year negotiation and in court out of court that ended up in a deal where Google would split two-thirds one-third of the revenue generated with all these rights holders. And for out of copyright books, people could read up to 20% of the text for free and then they would sell this kind of full digital access. And that was the deal. But then later, federal judge rejected that deal, which was eventually signed in 2008, 2009. And the federal judge said, "No way, send it back."

This isn't going to work. Google appealed.

And in 2015, second circuit court of appeals ruled in Google's favor and the whole thing was settled.

And they basically declared Google did in fact have fair use under copyright law in the way that they were showing snippets of copyrighted books in the material. Yes, you can read the entire book like it's a Kindle. You could search the book, find the paragraph, provide a reference to it. And so the question on fair use in AI is, can my understanding or extraction of value of the knowledge from the data in the book give me the ability to provide better answers to you through the AI chat interface or services.

And I'm providing you. And I think it's going to be Tesla. And I think we'll see. I do think fundamentally that the conversion of that data into what I would call knowledge and ultimately the ability to create new outcomes from that knowledge that are not copyrighted. That are not copies of the original material.

I do think is going to end up being the right fair use policy and it's going to be the right read on fair use.

So I think it'll likely get litigated and I think it'll take a couple of years and I'll get kind of.

Anything like these. Just to be clear, Jake, I have not changed my view on fair use. So I am with freeberg on this.

My point is the hypocrisy.

Yes.

If we're taking hypocrisy for anthropic to maintain that it is entitled to train on all the worlds output for free, even if the creator objects.

But the one type of output that you're not allowed to train on is their output even if you pay for it. That is their current position.

So, you know, what I'm saying is that, you know, if you want to train on anthropics output, that cannot be considered.

IP theft. Under fair use, especially given the fact that the courts have ruled that LLM generated output is not copyrightable because it was not created by a human. That is the current position of the courts is that LLM output cannot be copyrighted. You can make the argument and I think it's probably true that if a competitor creates massive numbers of fake accounts on your surface. Yeah, you're breaking.

That's definitely breaking the terms of service and it's probably a deceptive business practice. And there may be other things you can do. But I don't think you can pay on the jurisdiction, by the way, because in Philippines, Israel, India, they have different rules about like breaking the terms of service, which LinkedIn found out. When people started scraping their data from off any thoughts here before we move on to socialism corner, everybody's favorite new feature here, I mean, all in pod. I don't have to cut the books, keep it the books intact.

Why do you cut the books in the library? It's very hard to read them. It is a no spine.

I think it's not a kind and I don't like it to cut the books.

I mean, are you taking your time and you move it to page like a Google does? It says it's a little bit more time, but it's a little more graceful, yeah? Don't, don't, don't, don't, don't, don't, don't. I mean, you want to cut a tip. Don't get so one thing that you can do.

A free break has a cut tip, it's actually got a cut tip, but you don't cut the spine of the bottom. Cut the tip. It's a more classic. There's a great Guinness Book of World Records. Book, joke, oh no, where's this go?

Went to the library and I found that my dick was in the Guinness Book of World Records. And then, unfortunately, someone asked me to remove it. So you literally put it in the book and close the book. I'm not joking. That's the joke.

Yeah, it's like an apple pie. Hey, by the way, here's, we've got a photo. This is a photo. We actually have a photo that was leaked from the anthropic office. Here's the anthropic office, leaked photo.

You can't put it. Sorry, I'm wearing those books. What do you want to, Daria? Come on the show anytime. We've been focusing for three years.

Why hasn't he come on the show? Because you big fun of him.

I don't think you've never missed a guy.

And you've just insulted him all the time. You think he won't come on the show. I just said he's the guy who literally saw the most successful business in human history. Growing from under 10 billion of revenue to 70 billion or revenue at six months. and you insult the guy, you believe that he's going to come on your show and all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all the people that want us to be all

you know, many copies of them, and you can always make more. So it's not the end of the world's shredding, but I think the part of the story that got people upset was that they were acquiring all these rare books, whereas there was very low numbers of copies of them. They were finding all these rare and antique books because they wanted to slurp in all the world's knowledge, which they were shredding those. Yeah, that made people upset. If you're doing like Windows 3.1

for dummies volume four, like nobody cares, but anything that was like a first edition or like and they're in different books. Rare at a print box. Yeah, that gives you a training friendship, and that makes sense. All right, so quick socialism corner here. We got to cover the ongoing saga in my hometown where I am right now of New York City. Monde Donnie has announced five city on grocery stores, David. One per borough, they're using

city-owned space. They're all going to open by 2029, and one week per month, shoppers are going to

get a 30 percent discount, comrade, on their bread cheese, produce meat, and milk for the glory

of the country, regular prices, the other three weeks. They're not going to sell cigarettes, alcohol, hot food, all that stuff because they don't want to compete with the bodegas. It's going

to cost taxpayers 70 million. I mean, it's the only thing to discuss here is like what happens to

the other supermarkets now? Are they going to shut down because they can't make the whatever one or two percent they're making on groceries? Is there going to be like riots in the streets

To get into these places to get your milk for 30 percent off for one week a m...

the whole thing seems like a waste of time. But I will say, sacks, this place, this is going to play in elections, free stuff plays in an election, whether it's a bus or discounts. It may play

on, you know, luck when people first go to these stores and they first open and the shelves are full.

Yeah, the people will be like delighted and then over time what's going to happen is that the store shelves will be empty and it's going to be in constantly run and there's going to be a lot of complaints about it and then all the the free market stores are going to have to compete with this

and then they may get put out of business and so. And then you have no choice and you have to go to

the state sponsored one and then there is the price. And it is ironic that they're going to be checking ID to make sure people are coming over from Jersey. But if you want to come over illegally from any country in the world, well, that's fine. They found a use for ID. By the way, after you get your groceries, you have to hide your ID to go vote. Don't think, shred your ID going to go vote.

After you pick up your milk, they found a use for ID. What's your take here, free burger?

You need a favor of people paying less for groceries or are you a free market monster that wants people to pay full price for groceries? Especially starving for families. I've seen nothing but negative comments on the future failure of these grocery stores on Twitter. And I think that people have it wrong. I think these grocery stores are going to be wildly popular. They're going to pay their employees above market wages.

Employees are not going to have to work very hard to work there. So they're going to be a better place to work. Everyone's going to want to use them. They're going to outperform whole foods. They're going to outperform safeway. They're going to outperform Albert's sense. They're going to be so in demand that what will end up happening is that over the next 24 months. Every other city in America will look to these grocery stores and say we want the same. Yes. It's only New York.

Get these grocery stores. Why can't I have these grocery stores, too? Where I can have discounted food, where I can have the service provided to me by people that are getting paid above average wages,

above market wages. Why does this not become available to be in my city? So, you know, I think that

everyone's being a little bit to I would say long-sighted in their view on what's going to happen with these grocery stores would be, you know, basic obvious economic arithmetic that someone has to pay for this and who's going to pay for it and rich people. Well, I mean, the point is, I don't think

it really matters because over the near term, what the cheap grocery stores do is create an incredible

success story for socialism that will help to support and fuel the socialist waves in urban centers around this country. And I think that there will be media coverage of these grocery stores on how great they are and it'll be a 60 minutes piece. And everyone said, Zoron Mombani was crazy, but let's go in and take a look at this beautiful grocery store and they're going to walk through the grocery store. And they're going to be happy people taking food off the shelves checking out

with happy employees working at the grocery stores and it is going to be deemed a utopian dream come reality and everyone's going to want one. And it will help seed the next couple of years and it will be part of, as I've highlighted in the path, a big part of the, um, the multi-level marketing scheme of socialism is to create spectacle. And it will create more spectacle that will help to fuel the multi-level marketing scheme of socialism. And remember, the problem with all multi-level

marketing schemes at the end of the day is someone has to pay the bill and no one's actually buying the product, no one's paying for the product. That's a ways away though. In the next time, while it's here, in the meantime, it's going to take off. And I think that these grocery stores are going to be a much bigger success in socialism than a, than a demonstration of the failure of socialism, unfortunately. Yes. And so I think that, you know, everyone's got a little

bit wrong and assuming that this thing is going to radically fail. I think that these things are going to create a radical spectacle and exuberance for socialist policies that's going to kind of light a fire for socialism around the country, unfortunately, because at the end of the day, no one has to pay the bill because the bill doesn't come to you for someone else will pay it, it'll get paid in the future. It's not on top of the debt, all the rich people are getting debt.

Why can't the public have such money? Yeah, socialize the cost into money printing,

fueling more inflation, creating a spiral where you need to offer more stuff for free to come up

with a way to cover the cost of the inflation for people that can't afford things anymore. And the spiral will persist. So I think it's a sad state that the United States has to kind of embrace this policy. Interestingly, I think it's going to, I think it's going to end up being a a big part of the fuel for socialism over the next couple of years. Breaking news, breaking news. I don't know if you saw it just now came across the wire, but Bernie Sanders, AOC, um, and Tommy collaborating on

50% off bagels and bacon egg and cheese for the 1% of the 10% why can't you g...

Schmeer for less. That's what has to happen next. What would you like next? On your discounted

democratic socialism, scorecard, David Freeberg, what would you like next? discounted bagels,

a cafe, maybe a flat white? Where do they go next? But seriously, what's next? What would what would be next in this logical thread? Free buses, rent freeze, what's next? We'll think about the social network effect of the grocery store. So there's, there's a couple of them and then people start traveling from far away to the cheap grocery store because it has this discount. Long Island jersey. Yes. Again, this will play out over the next 24 months, going into the 2020 election cycle.

And everyone's like, this is so wildly popular. People are coming in from all over the place to go to these grocery stores. They're not checking IDs because IDs are racist. And, you know, you can't check IDs to vote. So we shouldn't be able to check IDs for grocery stores. So people will come in from all over the place to use these grocery stores. The demand will go up. And then

they'll start to open more and more grocery stores like this. And let's say each one loses 10 million

a year and they get to 10 or 20 of these. That's $200 million of losses per year on the grocery

store chain. But it creates this extraordinary social movement for more of these grocery stores supporting the DSA. Yes. So one, $200 million a year on a $125 billion dollar your budget for the city of New York. It's nothing. Nothing. It's less than a quarter of a percent of the city's budget. That is so cheap to market the DSA. Yes, platform and to get the DSA platform to become a social marketing element that drives the next wave here. So again, I do think that these grocery

stores believe it or not. They sound silly. They sound small. But I predict that they will be deemed a point of success. And they will end up being a big part of the fuel for the DSA going into 2028. I couldn't agree with you more. This is this is going to play. This will be a great, great feather in their cap. It's going to be a great example of affordability because we've talked about here previously. Trump promised affordability hasn't been able to deliver it, inflation's up,

spending's up, all that great stuff. And Mandami got it done. Free buses, rent controlled, and now you got your discounted grocery store. Both sides are reacting to the fiscal and monetary condition of the United States. We're overspending inflation is run away. So you just keep spending more and printing more to give people what they need, which is basic services. And so as the government spends more than the fundamental cost of those things goes up and you're reducing

economic productivity and it becomes a spiraling problem. It is a two-party problem. This is not just one side and the other. Because fundamentally, if you go, I've found a lot of time now in DC, I think everyone's well-intentioned in the White House and the administration in trying to reduce federal spending. But the bigger issue that you face is when you go to Congress and you meet with everyone in Congress, they are representing the interests of their state or of their congressional

districts. And they're objective. Their objective is to fundamentally drive spending towards their district to give their people more. Their economic incentive and their political incentive

is not to give people less, which is what you have to do when you cut programs, when you cut spending.

So the shift in the policy has been, hey, I guess we're not going to be able to cut spending

because there's just too much headwins in Congress. So the answer is, let's grow through economic

productivity gains and that's the big fuel for AI, the CapX depreciation of them, policy and so on. But I think that's been the shift. So look, the one thing I will say, critical of President Trump here is when it came to like starting a war, when it came to tariffs, he had no problem, like using executive power and telling Congress and everybody in the party, this is the way it's going to be if you break ranks, I'm going to destroy you. I'm going to get your primary

and when it comes to spending, he was like, yeah, you know what? I'm not taking that all and it's too unpopular. All right, Freiburg. The Sultan of Science's fans have been begging for a science corner. Do you have one this week? They want to know, do you have something? O Sultan, O Sultan of science? What can you tell us? Educate us. Okay, so today I'm going to pull up this paper. Nick, if you pull it up. Hmm. A paper from February, 2020, February. Okay, February,

February, February, February, February, February, February, February, February. Oh, it's February. Well, February, February, February. Okay, so this is a group of researchers out of Budapest. Budapest. And there was a really interesting modeling exercise they went through to understand how neurons were connected in the brain to build a network model, a topological model, and the way they were able to do this is back in October of 2024. There was a group out of Cambridge and Princeton

that used electron microscopes to scan the brain of the drossophilia fruit fly and they mapped

Every single neuron in that fruit fly's brain.

had to other neurons in the brain. So there were 50 million synaptic connections between the neurons.

And it's those connections that make neural networks in the brain work. How are those neurons

network together to do the things that they do? This is the key question in what is that network

model? What is the topological model of how neurons connect in the brain, which gives rise to our ability to control our bodies, to seeing things and comprehending vision, comprehending sound, and even the basic premise of consciousness itself. Yes. So trying to understand the network model for neurons has been this kind of great endeavor of neurobiology forever. This data set was created in October 2024 with just 539,000 neurons. And you know, that's a tiny, tiny, tiny brain.

Yeah, this is, but with those, put it in context versus the human brain. I mean, what are we talking

about here? Like, the human brain has on the order of 86 billion neurons. Okay, conserve that means

to be a multiple for the network connections, right? Yes, exactly. On the order of trillions of connections. Okay. So they took these 50 million connections in the brain and the 139,000 neurons. And then they applied the network model that predicts whether a neuron is connected to another

neuron, that's how you're measuring the quality of the model, how correct is it in making a prediction.

And when you build the model using what's called Euclidean geometry, so just normal space that we live in, three-dimensional space, they came up with a score and the score was not very good. You couldn't do a great job of just looking at how all the neurons were connected using their physical relationship to each other. How far apart they are to each other in 3D space. So then they said, well, let's try and model how these neurons are all connected to each other in what's called

hyperbolic space. Hyperbolic space is a theoretical type of space, unlike Euclidean geometry, where the further away you get, the wider space gets. So space actually is curved. I know that's a hard concept to describe, but imagine that, you know, as you and I walk farther and farther apart from each other, the area around us actually accelerates in terms of how much space there is. And it expands.

It would be space like three dimensional space as humans understand it when they're on planet Earth.

It's a little bit more like space that you would experience in the the warping around a gravity well or the warping around a black hole or something like that. And so in that space, they found that this is where the model was most performative. They were able to map in hyperbolic space, how all of these neurons connect to each other. And if you think about it, the further away you get from the first neuron, you're going to have many, many more neurons

you can start to tap into. And so hyperbolic modeling on the neuronal connections actually makes sense and they got a decent score. And then they went back and they said, well, what if we could use Euclidean geometry, but not in three dimensions, but they went up to four, five, six. And they found that they were able to kind of get as good as the hyperbolic space at 64 dimensions. So by taking normal space and saying, let's use a 64 dimension framework for how we can start to connect all these

neurons together, that's where they had the best predictive model. This is a really interesting kind of discovery. First of all, it can be used for neural network design and AI and other sorts of things. But for me, it highlights the miracle of biology in finding complexity in 64 dimensions, not in three dimensions, but in 64 dimensions, biology found a way to create consciousness, to create vision, to create comprehension, to create control over physical bodies. Then to map it

and squish it all into a tiny little brain, it did this in effectively 64 dimensions. I'm blowing when you think of it because a fruit fly or mosquito and, you know, these things, they don't have like a big mission, right? Like their mission is to go find food and procreate. I guess they have a very simple mission to dig. Wow, but then we also wanted to podcast and debate politics and philosophy, don't you tell them the speed of spends their free time? Well, I mean, but nobody would

argue there's like consciousness as we experience it in a fruit fly. So then you get to trillions, you wouldn't know, but maybe this is really interesting because it turns out that the biology of

how all the neurons are connected, even in a brain as simple as a fruit fly with 50 million connections,

is so complex that it has to take 64 dimensions for us to represent how those networks are built, how they're made. And at 64 dimensions, you could start to argue that perhaps consciousness is a connectivity to a dimensionality that we don't live in every day, you and I don't live in every day. And then I can't comprehend. And that it is this extraordinary complexity in 64 dimensions

That gives rise to consciousness, that gives rise to our capacity as biologic...

very simple thing of thinking. I just think that it was such a powerful and amazing paper in just

bringing forth these numbers and showing just network modeling on this tiny little brain as being just a glimmer into the complexity of how biology has found a path beyond our kind of understanding, even a physics into this universe that we can't even comprehend. And it shows how little we know. We know very little, but then as you sort of alluded to here, and as we talked about in the top of the show, we have AI, Frontier Labs saying, Hey, reinforcement learning is like super dangerous,

because these things could get out of control. Are you, you know, in the camp of we are rebuilding in this simulation or whatever we're experiencing here, we are in fact recreating our brains with silicon and that, you know, we're on the way to actually creating consciousness that a replicant in science fiction like Blade Runner, where they don't even know, you know, Rachel doesn't know she's a replicant spoiler alert. You had 50 years to see the film. Like a you part of that camp,

that's actually what's being built here. Yeah, I'm not sure. It's a longer conversation. We should do another time. Yeah, but I do think there's something fundamental to consciousness that relates

to the drive for survival in a physical sense. You have to have physical sensing and physical

responsiveness to learn as a baby. You first start touching hot stuff and cold stuff. And you learn, and we build these reward mechanisms in to neural networks that we build in AI, but those reward mechanisms are digital and their program. And the question is there are reward mechanism that arises in biology that creates a different capacity for consciousness than perhaps can exist in silicon. A bigger topic for a different day with probably people that have spent

more time thinking about it than I, but I just think that there's something about biology,

you know, I always tell people this this analogy. I've said it many times on the show I'll say it again.

In a single cell, there's 10 billion proteins that work so fast that one second is the equivalent of 80 years of humans walking around the city of Manhattan never sleeping doing stuff together with 500 story tall skyscrapers doing stuff for 80 years is one second in one cell. And so you have 10 trillion cells in your body doing that, living that entire universe every second, all interacting with each other. And you start to realize that there's a complexity in what's

emerged in biology that extends well beyond any model we've built in silicon today. Yeah, doesn't mean that the silicon that we're building today doesn't create extraordinary capacity for humanity, but we are very early. And the more we kind of understand this sort of

thing like this paper that I just shared, I think the more we realize how little we do know

and how much of a frontier there still is to explore. Yeah, and I think, you know, this obviously brings up faith and do you believe that there's a God that set this in motion. I like to believe there is some higher work here, and this is my closest analogy in science fiction. We're both superfans of science fiction, but for me, 39 seconds in here, one of the great ones. I love the chromatious version of this year. There's engineers who are terraforming and started this crazy

thing out, and there's this experiment in biology going on. And you know, the opening scene here and from you this, he drinks this, and this is the sacrifice like Jesus, um, was sacrificed for humanity. And he sacrifices him here by drinking that biological design, right? And he falls into this, you know, planet Earth, which is just water. And this is the Cambrian explosion where his DNA goes into the river gets washed out and then starts the cycle of life on planet Earth. And that

these engineers are going around. It's pretty fantastical. Yeah. A lot of this stuff is a simple way of humans trying to explain stuff, but the complexity that arises in biology, we just can't explain

and I think we try and use these reductive kind of heuristics to try and do it, and it's very

storytelling. It's comforting, because it's so overwhelming, the complexity of how this stuff emerges is too overwhelming. So we create simple stories to try and help ourselves feel better. And yeah, this is my, and that's my favorite story of it. In somewhere between Blade Runner and

this, by the way, both of the same incredible director, uh, really Scott. Uh, so take it for

what it's worth. All right, everybody, another amazing episode. You got your science corner. See you next time, bye, bye. I love you, besties.

, besties are gone.

Besties are gone. Besties are gone. Besties are gone. I'm going, darling. I'm going, darling.

Compare and Explore