Meta’s storied AI research lab faces existential questions amid leadership changes and internal reshuffling—while its founder insists it’s just entering a new chapter.
That’s true but at least one of these things needs to happen:
the forklift costs billions and consumes tons of energy, but it can lift a whole mountain, which no group of humans can do
the forklift helps a team of 10 do the work of 50 and, while still relatively expensive, it costs less than the 40 people it’s replacing
the forklift becomes an inexpensive commodity and it augments human capabilities and creates new possibilities for society as a whole
This is roughly what happened with mainframes to personal computers to mobile devices. LLMs are stuck between 1 and 2, they are not good enough forklifts to lift a mountain and not cheap enough to replace 40 people and save money. There are some hints that they could at one point move to 3 but the large players that could make it happen are starting to be scared by the amount of investment to get there.
On a related note, lot of people are being fooled by this hype machine mixing GenAI with good “old” machine learning and you now read about all these “AI wins” like “student discovers new galaxies with AI” or “scientist discover new medicines with AI” that make it sound like these people just asked ChatGPT “how would you go about discovering a new galaxy?” or “could you make up a new drug for me pretty please?”.
I think back to the late 90’s investment in rolling out a shitload of telecom infrastructure, with a bunch of telecom companies building out lots and lots of fiber. And perhaps more important than the physical fiber, the poles and conduits and other physical infrastructure housing that fiber, so that it could be improved as each generation of tech was released.
Then, in the early 2000’s, that industry crashed. Nobody could make their loan payments on the things they paid billions to build, and it wasn’t profitable to charge people for the use of those assets while paying interest on the money borrowed to build them, especially after the dot com crash where all the internet startups no longer had unlimited budgets to throw at them.
So thousands of telecom companies went into bankruptcy and sold off their assets. Those fiber links and routes still existed, but nobody turned them on. Google quietly acquired a bunch of “dark fiber” in the 2000’s.
When the cloud revolution happened in the late 2000’s and early 2010’s, the telecom infrastructure was ready for it. The companies that built that stuff weren’t still around, but the stuff they built finally became useful. Not at the prices paid for it, but when purchased in a fire sale, those assets could be profitable again.
That might happen with AI. Early movers over invest and fail, leaving what they’ve developed to be used by whoever survives. Maybe the tech never becomes worth what was paid for it, but once it’s made whoever buys it for cheap might be able to profit at that lower price, and it might prove to be useful in the more modest, realistic scope.
That’s true but at least one of these things needs to happen:
the forklift costs billions and consumes tons of energy, but it can lift a whole mountain, which no group of humans can do
the forklift helps a team of 10 do the work of 50 and, while still relatively expensive, it costs less than the 40 people it’s replacing
the forklift becomes an inexpensive commodity and it augments human capabilities and creates new possibilities for society as a whole
This is roughly what happened with mainframes to personal computers to mobile devices. LLMs are stuck between 1 and 2, they are not good enough forklifts to lift a mountain and not cheap enough to replace 40 people and save money. There are some hints that they could at one point move to 3 but the large players that could make it happen are starting to be scared by the amount of investment to get there.
On a related note, lot of people are being fooled by this hype machine mixing GenAI with good “old” machine learning and you now read about all these “AI wins” like “student discovers new galaxies with AI” or “scientist discover new medicines with AI” that make it sound like these people just asked ChatGPT “how would you go about discovering a new galaxy?” or “could you make up a new drug for me pretty please?”.
I think back to the late 90’s investment in rolling out a shitload of telecom infrastructure, with a bunch of telecom companies building out lots and lots of fiber. And perhaps more important than the physical fiber, the poles and conduits and other physical infrastructure housing that fiber, so that it could be improved as each generation of tech was released.
Then, in the early 2000’s, that industry crashed. Nobody could make their loan payments on the things they paid billions to build, and it wasn’t profitable to charge people for the use of those assets while paying interest on the money borrowed to build them, especially after the dot com crash where all the internet startups no longer had unlimited budgets to throw at them.
So thousands of telecom companies went into bankruptcy and sold off their assets. Those fiber links and routes still existed, but nobody turned them on. Google quietly acquired a bunch of “dark fiber” in the 2000’s.
When the cloud revolution happened in the late 2000’s and early 2010’s, the telecom infrastructure was ready for it. The companies that built that stuff weren’t still around, but the stuff they built finally became useful. Not at the prices paid for it, but when purchased in a fire sale, those assets could be profitable again.
That might happen with AI. Early movers over invest and fail, leaving what they’ve developed to be used by whoever survives. Maybe the tech never becomes worth what was paid for it, but once it’s made whoever buys it for cheap might be able to profit at that lower price, and it might prove to be useful in the more modest, realistic scope.