jsheard 4 hours ago

> OpenAI considered building everything in-house and raising capital for an expensive plan to build a network of factories known as "foundries" for chip manufacturing. The company has dropped the ambitious foundry plans for now due to the costs and time needed to build a network

That framing massively undersells how insane Sams ambitions were there, he was floating the idea of somehow raising seven trillion dollars to build thirty six fabs dedicated to making AI silicon. The TSMC execs reported more or less laughed in his face when he brought it up it them.

  • onlyrealcuzzo 4 hours ago

    As anyone with 2 brain cells should have.

    You don't just acquire $7T.

    The ENTIRE US domestic Net Investment isn't even $1T: https://fred.stlouisfed.org/series/W790RC1Q027SBEA

    Gross Fixed Capital Formation (Net Investment + Deprecation) isn't much more: https://fred.stlouisfed.org/series/NFIRSAXDCUSQ

    Google, Apple, and Microsoft together don't even spend $100B on CapEx per year. And they're worth almost $10T put together.

    Asking for $7T when you're a $100B company is so ridiculous it's beyond belief.

    • wheels 3 hours ago

      And if it was a 30% stake in OpenAI for that $7 trillion (kind of a standard VC round percentage) that would put OpenAI's valuation at about the same of all of the 7000-ish NASDAQ companies (including almost all public tech companies) combined.

      • lumost 3 hours ago

        There was probably a point of maximum hype ~12 months ago, or right after the launch of GPT-4 where the belief of imminent singularity was running high.

        • bugbuddy an hour ago

          But, singularity is still imminent. Right? Where on the spectrum of completely useless/no AI to singularity are we at?

          • bckr an hour ago

            It’s gonna require N more hype cycles (bearing in mind that usefulness is the expected endpoint of the hype cycle)

    • hu3 4 hours ago

      He would have to have AGI proof to ask for this unprecedented kind of investing money.

      And even them it would have to be split during a decade or two. And even then.

      What's the military budget of USA?

      • onlyrealcuzzo 3 hours ago

        It doesn't matter what the military budget is.

        Most of it is spent on personnel and operation.

        You'd want to know only what the procurement is - which is ~$146B: https://en.wikipedia.org/wiki/Military_budget_of_the_United_...

        And most of that is part of Gross Fixed Capital Formation already...

        • ipaddr an hour ago

          What is dark budget look like these days.

        • dgfitz 2 hours ago

          It’s funny how that bit only comes up when HN wants to use it to make a point.

      • colechristensen 3 hours ago

        >What's the military budget of USA?

        Somewhere between $900B and $1T this year

      • cedws 2 hours ago

        Yeah, I mean, what else would you do with those chips? Run LLMs faster? Sorry but the killer app is still not there, the majority of people do not care and have no use for them.

        • HKH2 an hour ago

          I wonder what proportion of students use them for homework etc. The coming generations of people will care less about writing style.

        • Zopieux an hour ago

          Don't you dare question the usefulness of gen ai on the hacker news. Many folks haven't caught up with reality just yet.

    • sroussey 3 hours ago

      Does anyone have a source for this “$7T” number?

      I read it on the internet myself with “sources saying” but I think it’s BS.

  • cal5k 4 hours ago

    It's kind of admirable, though. If you start asking for $7T, only asking for $1T becomes quite reasonable ;-)

  • jordanb 2 hours ago

    And to think Satya Nadella looked at this guy and his plan and said "this is the kind of stable genius we need running OpenAI."

    • cedws 2 hours ago

      Or he’s the perfect guy to give MS freedom to dig their claws in.

  • xyst 4 hours ago

    It’s just 1/5th of the current USA national debt of $35T, bro. Just have fed run those money printers 365/24/7.

  • a13n 3 hours ago

    It could have been strategy instead of insanity. By starting conversations at $7T you anchor high and potentially drive a greater outcome than starting an order of magnitude lower.

    • rurp 3 hours ago

      That strategy only works if the anchor is in the realm of reality. If I'm selling a 20 year old Toyota Corolla and initially ask for $900,000 that's not going to help me get a higher price.

      • yreg an hour ago

        Anchoring bias probably works with numbers outside of the realm of reality as well. But I doubt it's very useful in these cases (or even any stronger than asking for say 300B), otherwise everyone would always start a funding round by asking for a 7T investment, right.

      • a13n 2 hours ago

        there are millions of corollas there’s only one openai

        • jsheard an hour ago

          It's become a running theme that there are in fact a lot of OpenAIs, with how frequently their models get matched or leapfrogged by competitors.

        • bravetraveler an hour ago

          Not really that many fabs either. They do this on that scale, they only need the AI to fill demand lol

    • jsheard 3 hours ago

      Usually when doing anchoring you want to end up at a result less than what you originally asked for but crucially more than zero, and OpenAI immediately folded on building any fabs whatsoever, so I don't think it worked.

    • adventured 3 hours ago

      When you do something that stupid - starting at $7 trillion - you end the conversation before it really begins because you lose all credibility with the people that matter (eg TSMC and other investors).

      If he had said $250 billion and six fabs, it would have been a lot to ask but people wouldn't think he was ignorant or irrational for saying it. Big tech for example has that kind of money to throw around spread out across a decade if the investment is a truly great opportunity.

      • onlyrealcuzzo 3 hours ago

        Asking for $7T is - seriously - only slightly more absurd than asking for infinity dollars.

        • lyu07282 3 hours ago

          I guess he thinks his glorified markov chain will lead to ASI if scaled up sufficiently. Even if we get ASI, the likelihood that anybody will ever make any money from it is so delusional. This isn't going to be your average brainwashed peasant, crushing these capitalist pigs is probably the first thing it's gonna do.

          • GaggiX 2 hours ago

            This comment honestly feels delusional.

      • coredog64 an hour ago

        The technical term for this is “zone of possible agreement”. If your opening is outside the counterparty’s ZOPA, then they’re likely to disengage/exit.

  • bronco21016 2 hours ago

    > The TSMC execs reported more or less laughed in his face when he brought it up it them.

    Reminds me of:

    Musk flew there with Cantrell, prepared to purchase three ICBMs for $21 million. But to Musk's disappointment, the Russians now claimed that they wanted $21 million for each rocket, and then taunted the future SpaceX founder. As Cantrell recounted to Esquire: “They said, 'Oh, little boy, you don't have the money?”

  • bravetraveler 2 hours ago

    Maybe I'm just jaded, but I think even one fab deserves a laugh. Design, sure. Fabrication? Hah.

  • ForHackernews 3 hours ago

    Approaching Adam Neumann-levels of grandiosity.

    Could it be possible that OpenAI's new autocomplete will be as transformative to the global economy as WeWork's short term office rentals?

  • Cthulhu_ 3 hours ago

    And that's 7T just to build the fabs, then they'd need tons more money to build the hardware to put the chips in, datacenters, staff, software, etc.

  • kkielhofner 4 hours ago

    For reference seven trillion dollars is 25% of US GDP.

    Yeah, that's um, wild.

  • shreezus 4 hours ago

    [flagged]

    • snovv_crash 3 hours ago

      $7T can buy a hell of a lot of human intelligence. At that price I'm not sure AS/GI is cost competitive.

      • bboygravity 3 hours ago

        You think summoning machine god would not be cost competitive? God as in smarter than all of humanity combined times infinity (or at least a very large number).

        Earning back the 7T with god/satan on your side could be trivial and at the same time the least of your worries for other reasons (maybe god doesn't like you and/or doesn't care about you).

        • maronato 31 minutes ago

          This is crazy. How can you look at the current state of technology and think that something even remotely close to “smarter than all of humanity times infinity” is near? Tech paradigm shifts will definitely happen and improve current AI by a lot, but if creating “god” is the goal, 7T would be better spent creating a mega transmitter and asking aliens to just give us the tech.

        • nobunaga 3 hours ago

          Some people (like yourselves) are so delusional that you are capable of considering wasting 7T$ on something that is a glorified autocomplete technology. We kind of a need a reset in the tech industry to get rid of mindsets like yours. AGI is still so far away and when the AI bubble eventually bursts, you will probably still try to convince yourself it still only needs 7T$. The state of people in the tech industry is sad.

          • meiraleal 3 hours ago

            > Some people (like yourselves) are so delusional that you are capable of considering wasting 7T$ on something that is a glorified autocomplete technology.

            You know that to many, you are the delusional one if you think that some fictional number in a screen is more important than this glorified autocomplete technology that has the potential to revolutionize humanity as much as agriculture, electricity and the internet.

        • talldayo 2 hours ago

          > God as in smarter than all of humanity combined times infinity (or at least a very large number).

          This is delusional. Nobody has demonstrated AI that can even match the output that human creativity has accomplished in the past 5 years. It will take an awful long time before it's up there alongside humans, and by the time it surpasses us we'll both be long dead.

          If you're not just being performative for a joke here, then I don't even know how I can explain how wrong you are. All of this - the promises of "AGI", the bajillion-dollar meme order sent to TSMC, the cryptic sama tweets in lowercase - it's performance art. It's unsubstantiated, nondilineated, unproven, unstudied nonsense. That's it. I'm sorry if I hurt your feelings, the crypto bros had to go through this a few months ago and it was tough for them too. But the dividends have to be paid, and in a few years time your "$7 trillion dollar" intellectual property empire will be sand.

  • atleastoptimal 2 hours ago

    If you don't believe ASI is possible, 7T is way too high. If you believe ASI is possible, 7T is wayyy too low, thus 7T is a compromise if you believe there's a non-certain chance of ASI being possible

    • camjw 2 hours ago

      Surely this “logic” applies to every positive amount of dollars. Why not 700T

      • pixl97 an hour ago

        So the question is, if you have AGI/ASI how much productive work could you get done with it?

        When looking at things like mechanization and the productivity increases from around 1880 to now, you took an economy from around 10 billion a year to 14 trillion. This involved mechanization and digitization. We live in a world that someone from 1880 really couldn't imagine.

        What I don't know how to answer (or at least search properly) is how much investment this took over that 150 year period. I'm going to assume it's vastly more than $7 trillion. If $7 trillion in investment and manufacturing allowed us to produce human level+ AI then the economic benefits of this would be in the tend to hundreds of trillions.

        Now, this isn't saying it would be good for me and you personally, but the capability to apply intelligence to problems and provide solutions would grow very rapidly and dramatically change the world we live in now.

        • SketchySeaBeast 12 minutes ago

          > If $7 trillion in investment and manufacturing allowed us to produce human level+ AI then the economic benefits of this would be in the tend to hundreds of trillions.

          Sure, but right now that "if" is trying to do 7 trillion dollars of unsubstantiated heavy lifting. I might be able to start creating Iron Man-style arc reactors in a cave with a box of scraps and all I ask is 1 trillion, so you all should invest given how much money unlimited free energy is worth.

    • cedws 2 hours ago

      How do you even define ASI? How do you know it will run on silicon? If it will run on silicon, what kind of silicon? GPU? TPU? Binary? Ternary? Von-Neumann architecture? How can you even start to build chips for something completely imaginary?

textlapse 9 minutes ago

Other than GH Copilot (which is amazing) and the like, I am yet to see a social/cultural impact of LLMs. I am ignoring the hype cycle fueled social media posts where influencers show cool stuff or model releases. I am talking about this stuff permeating through the society.. am I immune to it? Or is it hidden in saas/enterprise products layers deep?

I would imagine some productive cultural impact that’s wide spread, sticky, high retention not like ‘oh cool 3d tv or vr’ kinda thing?

Given how much ‘money’ has been burnt through the GPU heatsinks.

latchkey 4 hours ago

  "while adding AMD (AMD.O), opens new tab chips alongside Nvidia (NVDA.O), opens new tab chips to meet its surging infrastructure demands"
Jensen has been saying that demand is "insane" and we're hearing rumors of low yields. This equates to supply issues in the coming months/years. No fortune 500 puts all their eggs into one basket. Diversifying away from a single source for all of AI hardware and software, is a smart thing to do.
  • vineyardmike 4 hours ago

    > Diversifying away from a single source for all of AI hardware and software, is a smart thing to do.

    I wonder how this squares with the exclusivity contract with Microsoft. Even the OpenAI/Oracle deal requires Oracle to run Azure stack on their datacenter so MSFT can mediate the relationship. The AMD chips mentioned are also purchased by MSFT.

    I wonder if this really means that OpenAI is accepting the risk/capital expense while providing a variety of hardware to Microsoft, or if there are other terms at play.

  • bloodyplonker22 2 hours ago

    That is exactly what the execs at my company are telling us when asked about not using Nvidia -- diversifying away. It's funny though because we have no Nvidia for training at all. We use Trainium because we could not get our hands on Nvidia.

    • latchkey 2 hours ago

      I'm guessing you also got some free/discounted credits?

      Not sure of the pricing, but the performance of their chip is pretty outdated at this point. MI300x is way faster and more memory.

fuddle 3 hours ago

How long would take them to get a new chip into production and then used for training/inference?

  • wmf 3 hours ago

    The first generation chip won't be good enough to use in production so then you have the second generation... maybe 3-4 years.

  • KaiserPro 3 hours ago

    twoish years, if you're good. Then the software to make it work properly. its not a quick thing to do.

    You can throw more money at it to make it go faster, but it also might fuck it up and take longer.

qubitly 4 hours ago

Spending $7 trillion on in-house fabs sounded both ambitious and crazy. Reality finally kicked in. If they’re done dreaming big, let’s hope they keep the quality

bbarnett 2 hours ago

Broadcom! But that's where IP goes to languish and die.

whaleofatw2022 5 hours ago

I feel like them working with broadcom is another warning sign

  • mhandley 3 hours ago

    Broadcom also builds xPUs for Google, Meta and Bytedance. Maybe these companies know a thing or two.

  • plegresl 4 hours ago

    Why? Google also partners with Broadcom for TPU.

  • mgh2 5 hours ago

    Why? Care for references instead of opinions?

    • ZeroCool2u 4 hours ago

      I'm not saying that I necessarily agree, but the general consensus on HN seems to be that Broadcom is now less of a tech company and more of a holding company that raids others, for example VMWare, and extracts all value to the detriment of customers and the acquired company.

      I don't think that's completely wrong, but it's a big company and I'm sure there are some better areas of the company than others.

      • wmf 4 hours ago

        Broadcom has some really good chips and their semi-custom chip business is pretty successful. HN doesn't understand hardware so they don't know this.

        • alephnerd 4 hours ago

          [flagged]

          • razodactyl 4 hours ago

            I think the internet changed all over.

            It's a sign that we're moving on to greener pastures.

            Sucks for the new generation that think everything needs an app to work.

            The internet was better at feeling less corporate a decade ago.

      • nsteel 3 hours ago

        I think it's completely wrong in the context of its role as an ASIC partner. There's a very short list of companies with all the IP needed for these cutting-edge ASICs and Broadcom/Avago might be the best of them. And to be clear, they've developed that IP themselves, just as they've always done. Those that think they're just a "holding company" haven't actually worked with them.

        • lokar 2 hours ago

          It’s confusing. The PE buyout built a holding/looting company and owned Broadcom, and took the Broadcom name.

          So both are correct. Broadcom is a legit important hw company, and it is a PE holding company that buys and loots tech companies (like VMware)

      • blibble 3 hours ago

        it's no longer Broadcom

        Avago Technologies (owned by corporate raiders) bought Broadcom, then took its name for itself

        its ticker is still AVAG

      • alephnerd 4 hours ago

        > general consensus on HN

        General consensus on HN is generally wrong.

        • onion2k 4 hours ago

          General consensus on HN is generally wrong.

          I think everyone here would agree with that.

          ;)

        • hatthew 4 hours ago

          this makes sense since the general consensus on HN is that any general consensus on HN is right so if the general consensus on HN that any general consensus on HN is right is wrong then any general consensus on HN could be wrong

        • OrigamiPastrami 4 hours ago

          Is there somewhere the general consensus is generally right?

        • formerly_proven 4 hours ago

          Broadcom is on track to spend 10bn on RND this year. Basically a pure-play patent troll!

          • sroussey 3 hours ago

            Don’t they make the WiFi chips in iPhones?

      • 0x0203 4 hours ago

        Additionally, having worked with some of their network devices at the driver level, they seem to be kludge piled on top of hack poured over a soup of workarounds for hardware bugs. Maybe they've gotten better recently, but just looking at their drivers, it didn't paint a great picture.

        • sroussey 3 hours ago

          Oh god, I’d paint all hardware companies that way!

          Having been on both sides, I’m continually shocked that stuff even works.

    • observationist 5 hours ago

      Sam seems to be finding as many devils to bargain with as he can; Broadcom is a particularly devilish company.

      • crowcroft 4 hours ago

        Makes sense to work with them if they’re trying to design some kind of ASIC that would work for training or inference though?

      • worldsayshi 4 hours ago

        What have they done?

        • nick__m 4 hours ago

          They buy companies like VMWare and Computer-Associate, gut them and jack the price until they only have captive consumers from the fortune 500.

          • alephnerd 4 hours ago

            CA and VMWare were already dead on acquisition.

            Splunk+Datadog and AWS+Nutanix+Cohesity respectively ate much of CA and VMWare's marketshare.

high_na_euv 4 hours ago

So TSMC will eventually work with podcasting bro

>TSMC execs allegedly dismissed Sam Altman as ‘podcasting bro’ — OpenAI CEO made absurd requests for 36 fabs for $7 trillion

  • CryptoBanker 4 hours ago

    I’m sure they’ll work with anyone willing to pay