Discussion about this post

User's avatar
Nathan Witkin's avatar

Great article overall, but I can't get past the disparity between how scrupulous your work generally is and the story about full automation driving your relative optimism, esp. insofar as it's justified by this (commonly misinterpreted) METR figure.

I imagine you've encountered the main criticisms, but just to throw in my two cents, not only are the tasks at issue highly parochial relative to the economy writ large, but 50% success is just nowhere near the reliability you'd need to justify any level of automation. And don't find the growth rate very convincing either given how categorically different the challenge of 99(.999...)% reliability is relative to 50.

There are of course a ton of further, independent reasons widespread automation is unlikely (such as political ones), but to imply it's plausible on the basis of this particular figure screams 'epistemic double standard' to me.

Tumithak of the Corridors's avatar

Your car loan analogy for the circular financing doesn't hold up. When a car company finances your purchase, an actual car changes hands. You get use value, the loan is backed by a repossessable asset, and the company's revenue comes from manufacturing cars, not from lending.

What's happening with AI infrastructure is different. NVIDIA "invests" in OpenAI, OpenAI "commits" to buy NVIDIA chips, Oracle "commits" to buy NVIDIA hardware to serve OpenAI, and everyone books revenue on these commitments. The money (or more accurately, the promises) flows in a circle. It's not just "I pay you $100 to dig a hole, you pay me $100 to fill it." It's worse: I promise to pay you to dig, you promise to pay me to fill, and we both tell investors we've made $100 in revenue based on those promises.

This works as long as the promises eventually convert to actual economic activity. But if OpenAI is losing billions per month with a business model that would require subscription fees no sane user would pay, those promises aren't getting paid back. That's not timing risk. That's structural insolvency dressed up with IOUs.

And you can't finance your way out of physical constraints. NVIDIA can't deliver chips that require TSMC packaging capacity that doesn't exist. Every advanced wafer in the world has to fly back to Taiwan for packaging because that ecosystem exists nowhere else at scale. You can promise your way around financial constraints. You can't promise your way around semiconductor physics or power grid capacity or memory supply chains.

This only works if people don't check whether the promises can actually be fulfilled.

35 more comments...

No posts

Ready for more?