Comparing how traditional tech companies scale to how frontier AI companies scale doesn't seem very fair to me. AI is still relatively new territory, in comparison traditional software companies benefit from decades of investment in cloud infrastructure, networking, and hardware. I'm certain those technologies also went through periods of heavy investment before they became scalable.
The author also talks about advances like smartphones as though they arrived without significant challenges or trade-offs. Every major technological shift has come with some cost, e.g environmental, shortages, investments.
I'd argue most things are difficult to scale in the beginning. Just because today's LLMs are expensive and resource intensive doesn't mean the technology is fundamentally flawed, it may simply mean the current approach isn't the one we'll end up with. But naturally, someone working on another approach would have something to criticise about others.
Finally, I'm not convinced by the claim that we're "stuck" with LLMs just because they're heavily marketed. They create value for many people, which is why they've been adopted so quickly. As the author points out, investors care about economics. I'm sure people would listen if someone developed a cheaper/more sustainable technology that delivered the same value.
Right, if you came out with a technology that worked just as well as LLMs at half the power people/companies would jump at it from the absolutely massive savings in hardware and power. AI companies are looking at every other method they can, and inventing new ones, none of them have worked as well as the transformer so far.
> They create value for many people, which is why they've been adopted so quickly.
A lot of that adoption is completely useless crap tho. Like ai in vacuum cleaner that ads absolutely nothing useful to anything. AI buttons intentionally at places I randomly click at, so that I am forced to open it. Google search that defaults to ai, so that we have to use it after then nerfed real search.
There are useful usages of LLMs. But huge bulk of the adoption is companies realizing they wont get investors money if they dont add ai button, it does not have to be useful.
Which happens for every new technology. Blue LED's in everything, capacitive buttons on everything, car buttons replaced with ipads, et cetera. Some of the random placements will prove out useful but most won't and will disappear.
It is, in some ways, but no matter your opinion, AI in engineering will continue unabated.
Wrote about this recently (from a vibe coding perspective) [1]. This applies to corporations, too, as they're betting their futures on fewer engineers, more AI.
The ultra wealthy will out compete you for the resources you need if we don’t start taxing them has been a discussion from the left for quite some time. It seems to keep coming true in new and disastrous ways, we are going to see more and more extreme concentrations of capital and power distort things and pretty soon it won’t just be middle and poor people who cannot afford anything, the whole value chain is being redesigned around things billionaires want and what could be better for them than agents who replace all the white collar workers. You might think you’re safe from this, I don’t.
It’s worth remembering that during the industrial revolution in Britain, the fastest growing country the world had ever seen, most people were in abject poverty. This tech revolution might end up being worse.
Instead of just rejecting the future like a Roman fatalist because you've decided that it's just going to be someone else controlling you, maybe a better plan is to adopt emerging technology when it comes into play (like for example when the Internet came into play) and use it to start your own company, or make yourself more productive, or disrupt an industry that desperately needs it.
I shouldn't have to explain the benefits of productivity improvements and computer technology to people on Hacker News, but the place for some reason has been hijacked by neo luddites from Reddit that apparently have nothing better to do than troll about AI on a web site that is literally dedicated to an industry they don't like. Sam Altman literally used to run Y Combinator. Why not use that energy you're wasting to adopt emerging technology instead of bashing it?
There are places that recognized manufacturing was going to go away, transitioned a service economy, and did well economically, and places that ignored reality and are now in disrepair. Now's a great time to decide if you want to be Seattle or Cleveland. Don't fight the future. And don't think it's a billionaires fault when certain places are more successful then others because they didn't ban AI and datacenters while other places squandered the opportunity because they didn't confront the pitchfork mob driven into a frenzy by yellow journalism.
I love AI and have built many projects with PyTorch and use LLMs daily for all my work and am building a startup in my spare time here: https://veloa.com/
Being concerned about how AI will concentrate power doesn’t mean I don’t think it’s extremely useful.
"All everybody has to do is work and there will be no unemployment" --throwaway323929
Wow, you just solved economics!
Your argument is so incredibly reductive as to be nonsensical. The understanding of the allocation of capital is seemingly below grade school level. Even moreso, your understanding of the business cycle and how it interacts with governments and banks seems to be even more immature.
"manufacturing" didn't "go away", it moved to China so investors could capitalize on lax environmental laws and cheap labor. This engineered trade off of wealth had devastating results to massive parts of the US. On top of that, not every city can become Seattle. There isn't enough 'service economy' to go around and do that, especially as technology tends to concentrate wealth.
Why is the primary tech people impulse to disrupt, destroy and harm other industries? Maybe that is why we dont produce useful tech anymore. The primary impulse is always hostile, rarely something like "lets create and sell a useful thing for them".
> adopt emerging technology when it comes into play (like for example when the Internet came into play) and use it to start your own company, or make yourself more productive,
Funny, the strategy of creating a company entirely dependent on mercy of another company, vulnerable to destruction with any simple change in TOS has been criticized on HN previously.
If AI was utilized to eliminate the "shitty" jobs I'd be more enthusiastic about it. AI Robots that clean toilets so humans don't have to? Yes, please. (Yes, I get it that at present its probably still cheaper to employ a human wage slave to do this job -> the economic argument).
But at present AI seems to be just eliminating the junior programmer positions. That is, the apprentices. Once the more experienced engineers retire and die off who will replace them? AI? Who will have the knowledge and expertise to know what is crap software is and what isn't?
I would argue that it is rent-seeking and asset accumulation that is a big problem. If the wealthy elite invested in production rather than consuming assets that would improve things. I don't share his politics but someone like Elon Musk at least invests in production whereas Blackrock is heavily into asset accumulation.
However, part of the problem of why the wealthy elite don't invest in production is because of the Petro-dollar. When the USA moved to the Petro-dollar that is when the economy started to go K-shaped. The British Empire had the same problem. The Chinese absolutely do NOT want to become the World's reserve currency as they know the same fate will befall them. Perhaps the USA should have listened to Keynes with his Bancor currency after all.
They are neither investing in production nor consuming assets really. Any billionaire's yacht is an insignificant fraction of the world's resources. What matters is capital misallocation - they are investing in things that aren't productive that they think are productive and because they have too much money to invest, a too great share of society's resources are going towards those unproductive investments and productive activities are seeing shortages (e.g. the RAM crisis in PC and console gaming).
1000% I honestly believe this is why the US is such an economic powerhouse - the rich there deploy capital in a way that assumes optimistic win-win outcomes when they invest in startups! In the UK the investors are trying to get much higher percentages at half the valuation and it’s terrible for everyone even the investors to have people with 25% the upside of US companies.
Due to said industrial revolution, people's quality of life went up a thousandfold, same as in China and other countries now adopting capitalist principles.
Not true, that was WW2 and high taxation on the rich that created the middle class. The Industrial Revolution was 1750 onwards so maybe you’re okay with it taking nearly 200 years to get a good settlement for working people but I am not!
If you look at most of the world, Nigeria or India say you’ll see disgraceful levels of poverty and a small number of people who are ultra wealthy. This is where we are heading in the west if we can’t prevent the rich from inflating and buying all the assets you will own nothing and rent everything from them.
Ya'll are not ready for AI to just keep getting better and better. The slop-midwit-doomerism you are being fed as part of some last ditch copium that your SE identity matters and is going to be needed prevents you from seeing what is inevitable. You can't beat em. Try joining em.
i dont think the comparison to traditional vc saas is very good
yes, in traditional venture you want cost per marginal user to decrease and leverage your platform at scale
but improving llms shifts the frontier of their capability and unlocks entirely new use cases. so far, every mega training run has resulted in a model that has paid itself off profitably fully loaded. perhaps the TAM of intelligence has no ceiling?
not to say that we shouldnt be investing in efficient models, but the efficiency comes after we create another mega shoggoth that we can make more efficient
I can. AI says it will solve all problems, like curing cancer. Suppose it does. Now there are no more problems and no reason to run the AIs, at which time computing energy will fall rapidly.
The alternative is that there will always be problems, and we could spend as much as possible trying to compute solutions, but they will not be found.
Comparing how traditional tech companies scale to how frontier AI companies scale doesn't seem very fair to me. AI is still relatively new territory, in comparison traditional software companies benefit from decades of investment in cloud infrastructure, networking, and hardware. I'm certain those technologies also went through periods of heavy investment before they became scalable.
The author also talks about advances like smartphones as though they arrived without significant challenges or trade-offs. Every major technological shift has come with some cost, e.g environmental, shortages, investments.
I'd argue most things are difficult to scale in the beginning. Just because today's LLMs are expensive and resource intensive doesn't mean the technology is fundamentally flawed, it may simply mean the current approach isn't the one we'll end up with. But naturally, someone working on another approach would have something to criticise about others.
Finally, I'm not convinced by the claim that we're "stuck" with LLMs just because they're heavily marketed. They create value for many people, which is why they've been adopted so quickly. As the author points out, investors care about economics. I'm sure people would listen if someone developed a cheaper/more sustainable technology that delivered the same value.
Right, if you came out with a technology that worked just as well as LLMs at half the power people/companies would jump at it from the absolutely massive savings in hardware and power. AI companies are looking at every other method they can, and inventing new ones, none of them have worked as well as the transformer so far.
> They create value for many people, which is why they've been adopted so quickly.
A lot of that adoption is completely useless crap tho. Like ai in vacuum cleaner that ads absolutely nothing useful to anything. AI buttons intentionally at places I randomly click at, so that I am forced to open it. Google search that defaults to ai, so that we have to use it after then nerfed real search.
There are useful usages of LLMs. But huge bulk of the adoption is companies realizing they wont get investors money if they dont add ai button, it does not have to be useful.
Yeah there's a huge part of it that is "the investors want tulips, so we will plant tulips"
Thanks. You're comment made me laugh.
Which happens for every new technology. Blue LED's in everything, capacitive buttons on everything, car buttons replaced with ipads, et cetera. Some of the random placements will prove out useful but most won't and will disappear.
It is, in some ways, but no matter your opinion, AI in engineering will continue unabated.
Wrote about this recently (from a vibe coding perspective) [1]. This applies to corporations, too, as they're betting their futures on fewer engineers, more AI.
[1] https://graybearding.bearblog.dev/they-got-something-on-the-...
https://archive.ph/xo7RG
Approaching an AI version of https://hitchhikers.fandom.com/wiki/Shoe_Event_Horizon
The ultra wealthy will out compete you for the resources you need if we don’t start taxing them has been a discussion from the left for quite some time. It seems to keep coming true in new and disastrous ways, we are going to see more and more extreme concentrations of capital and power distort things and pretty soon it won’t just be middle and poor people who cannot afford anything, the whole value chain is being redesigned around things billionaires want and what could be better for them than agents who replace all the white collar workers. You might think you’re safe from this, I don’t.
It’s worth remembering that during the industrial revolution in Britain, the fastest growing country the world had ever seen, most people were in abject poverty. This tech revolution might end up being worse.
Yup. This is a policy problem.
Instead of just rejecting the future like a Roman fatalist because you've decided that it's just going to be someone else controlling you, maybe a better plan is to adopt emerging technology when it comes into play (like for example when the Internet came into play) and use it to start your own company, or make yourself more productive, or disrupt an industry that desperately needs it.
I shouldn't have to explain the benefits of productivity improvements and computer technology to people on Hacker News, but the place for some reason has been hijacked by neo luddites from Reddit that apparently have nothing better to do than troll about AI on a web site that is literally dedicated to an industry they don't like. Sam Altman literally used to run Y Combinator. Why not use that energy you're wasting to adopt emerging technology instead of bashing it?
There are places that recognized manufacturing was going to go away, transitioned a service economy, and did well economically, and places that ignored reality and are now in disrepair. Now's a great time to decide if you want to be Seattle or Cleveland. Don't fight the future. And don't think it's a billionaires fault when certain places are more successful then others because they didn't ban AI and datacenters while other places squandered the opportunity because they didn't confront the pitchfork mob driven into a frenzy by yellow journalism.
I love AI and have built many projects with PyTorch and use LLMs daily for all my work and am building a startup in my spare time here: https://veloa.com/
Being concerned about how AI will concentrate power doesn’t mean I don’t think it’s extremely useful.
"All everybody has to do is work and there will be no unemployment" --throwaway323929
Wow, you just solved economics!
Your argument is so incredibly reductive as to be nonsensical. The understanding of the allocation of capital is seemingly below grade school level. Even moreso, your understanding of the business cycle and how it interacts with governments and banks seems to be even more immature.
"manufacturing" didn't "go away", it moved to China so investors could capitalize on lax environmental laws and cheap labor. This engineered trade off of wealth had devastating results to massive parts of the US. On top of that, not every city can become Seattle. There isn't enough 'service economy' to go around and do that, especially as technology tends to concentrate wealth.
This has strong shades of BoJack Horseman's "We solved America's gun problem by giving everyone guns"
> disrupt an industry that desperately needs it.
Why is the primary tech people impulse to disrupt, destroy and harm other industries? Maybe that is why we dont produce useful tech anymore. The primary impulse is always hostile, rarely something like "lets create and sell a useful thing for them".
> adopt emerging technology when it comes into play (like for example when the Internet came into play) and use it to start your own company, or make yourself more productive,
Funny, the strategy of creating a company entirely dependent on mercy of another company, vulnerable to destruction with any simple change in TOS has been criticized on HN previously.
it's really funny when people advise the fix for widespread sociological problems as "just become an entrepreneur and disrupt an industry bro"
Did you adopt cryptocurrency in 2022? What were your results?
If you weren’t a coward you wouldn’t post this on a throwaway.
If AI was utilized to eliminate the "shitty" jobs I'd be more enthusiastic about it. AI Robots that clean toilets so humans don't have to? Yes, please. (Yes, I get it that at present its probably still cheaper to employ a human wage slave to do this job -> the economic argument).
But at present AI seems to be just eliminating the junior programmer positions. That is, the apprentices. Once the more experienced engineers retire and die off who will replace them? AI? Who will have the knowledge and expertise to know what is crap software is and what isn't?
I would argue that it is rent-seeking and asset accumulation that is a big problem. If the wealthy elite invested in production rather than consuming assets that would improve things. I don't share his politics but someone like Elon Musk at least invests in production whereas Blackrock is heavily into asset accumulation.
However, part of the problem of why the wealthy elite don't invest in production is because of the Petro-dollar. When the USA moved to the Petro-dollar that is when the economy started to go K-shaped. The British Empire had the same problem. The Chinese absolutely do NOT want to become the World's reserve currency as they know the same fate will befall them. Perhaps the USA should have listened to Keynes with his Bancor currency after all.
They are neither investing in production nor consuming assets really. Any billionaire's yacht is an insignificant fraction of the world's resources. What matters is capital misallocation - they are investing in things that aren't productive that they think are productive and because they have too much money to invest, a too great share of society's resources are going towards those unproductive investments and productive activities are seeing shortages (e.g. the RAM crisis in PC and console gaming).
1000% I honestly believe this is why the US is such an economic powerhouse - the rich there deploy capital in a way that assumes optimistic win-win outcomes when they invest in startups! In the UK the investors are trying to get much higher percentages at half the valuation and it’s terrible for everyone even the investors to have people with 25% the upside of US companies.
Due to said industrial revolution, people's quality of life went up a thousandfold, same as in China and other countries now adopting capitalist principles.
Not true, that was WW2 and high taxation on the rich that created the middle class. The Industrial Revolution was 1750 onwards so maybe you’re okay with it taking nearly 200 years to get a good settlement for working people but I am not!
If you look at most of the world, Nigeria or India say you’ll see disgraceful levels of poverty and a small number of people who are ultra wealthy. This is where we are heading in the west if we can’t prevent the rich from inflating and buying all the assets you will own nothing and rent everything from them.
https://x.com/PalmerLuckey/status/2077216959930728889
Ya'll are not ready for AI to just keep getting better and better. The slop-midwit-doomerism you are being fed as part of some last ditch copium that your SE identity matters and is going to be needed prevents you from seeing what is inevitable. You can't beat em. Try joining em.
i dont think the comparison to traditional vc saas is very good
yes, in traditional venture you want cost per marginal user to decrease and leverage your platform at scale
but improving llms shifts the frontier of their capability and unlocks entirely new use cases. so far, every mega training run has resulted in a model that has paid itself off profitably fully loaded. perhaps the TAM of intelligence has no ceiling?
not to say that we shouldnt be investing in efficient models, but the efficiency comes after we create another mega shoggoth that we can make more efficient
https://archive.ph/20260715223901/https://www.theatlantic.co...
I can't imagine a successful civilization where non-computing energy usage isn't a rounding error.
I can. AI says it will solve all problems, like curing cancer. Suppose it does. Now there are no more problems and no reason to run the AIs, at which time computing energy will fall rapidly.
The alternative is that there will always be problems, and we could spend as much as possible trying to compute solutions, but they will not be found.
Maybe we'll all upload ourselves to the Dyson sphere, so there will be nothing left but computation.