jsheard 9 hours ago

Since OpenAI bills you for tokens expended on chain-of-thought, I assume this "deliberative alignment" has the funny side-effect of making you pay for the time the model spends ruminating on whether it should refuse to do what you asked it to do. Talk about adding insult to injury.

  • xxpor 9 hours ago

    Maybe the most convincing argument yet that this is similar to how humans think.

    • skinner_ 8 hours ago

      Okay, but is this similar to how humans bill you?

      • PhunkyPhil 8 hours ago

        Yes, a lawyer could refuse your case after consulting them and their time considering the case.

        • uncomplexity_ 8 hours ago

          and sometimes they charge $1k per hour and still not have solutions after that hour

          • batmaniam 7 hours ago

            The point of technology is to make our lives easier and cheaper. There's no point to have chatgpt to charge this way other than to make the capitalist owners more money.

            Otherwise the self-serve machines at Mcdonalds should cost the company the same as an employee with a fair salary. Mass assembly lines building cars and machines should cost the same as 100+ workers including costs of health benefits and breaks.

        • stogot 7 hours ago

          How often does this happen? I’ve consulted lawyers for an hour who refused to support my case , and was billed nothing

          • danpalmer 6 hours ago

            At the lowest end of the industry it’s common to get free consultations because it’s too much expense for individuals otherwise, but in corporate law or higher end services I believe it’s much less common.

  • 486sx33 5 hours ago

    So … hypothetically, I Spent $5 on tokens to figure out the answer - then got an answer that my answer is blocked !

  • whamlastxmas 5 hours ago

    I don’t really see this any differently from an API billing you per call and still billing you for calls that where you pass in wrong credentials and get unauthorized error responses

jordanmorgan10 8 hours ago

This video format is killing me. Would love to keep up with the announcement but I have no desire for 10-20 minute videos.

  • muratsu 7 hours ago

    I strongly agree. I stopped checking their page for news after day 2 due to video only announcements.

  • layer8 8 hours ago

    AI video summary at your service:

    In this video, Sam Altman and team introduce OpenAI o3 and o3-mini, showcasing their advanced reasoning capabilities and performance benchmarks compared to earlier models. The session highlights the models' robust accuracy in coding and mathematical tasks, as well as new safety testing initiatives involving community participation. The o3-mini is noted for its cost-efficient performance, while safety strategies are enhanced through deliberative alignment.

    ## Key Points

    ### Introduction to o3 and o3-mini models

    During the final day of their 12-day event, OpenAI announces two new models: o3 and o3-mini. These models are positioned as advancements in AI reasoning capabilities, following the success of the earlier o1 model.

    ### Performance benchmarks

    The o3 model achieves significant improvements in capabilities, scoring 71.7% on software benchmarks and reaching near-expert levels on competitive math exams. In comparison to o1, it shows over 20% improvement in coding tasks.

    ### Safety testing initiatives

    OpenAI emphasizes safety testing for the new models, opening access for researchers to facilitate public testing. The goal is to ensure models are safe for general use while their capabilities are further validated.

    ### Introduction of o3-mini

    The o3-mini is presented as a cost-efficient alternative to o3, also equipped with strong reasoning powers, allowing adjustable thinking time to optimize performance based on user needs.

    ### New safety techniques: deliberative alignment

    A new safety training technique, deliberative alignment, uses reasoning capabilities of the models to create better safety benchmarks, enhancing the ability to accurately reject unsafe prompts.

    ### Future developments and availability

    The video concludes with information on how to apply for early access to test these models with expectations of full public availability in early 2025, alongside a call for safety researchers to contribute.

    • uncomplexity_ 7 hours ago

      the mini models are the most exciting to me. they seem to hit the balance of general utility and cost.

      people are fond of comparing large bleeding edge models, but when we compare the small ones to say gpt3.5, it is still astonishing.

      to me the smaller models being the balance of intelligence and cost is the best indicator of what the general population can use and afford.

      the larger models end up being used mostly by individuals teams and orgs who can afford to pay for it and learn how to use it.

      keep in mind at this day and age there is still a lot of people who dont know these things exist. it's just outside of their reality. then there are who have the slightest idea about it, but won't commit the time and money needed to learn it and fully experience it.

      this is like the new generational transfer of wealth and information. even if you're an individual or a small team, with enough levers you can use these technologies to your advantage, and with more levers (like yc) you can enter the battlefield and compete with existing companies.

    • karimdaghari 8 hours ago

      It's a bit ironic that it got the availability date wrong no?

      • layer8 8 hours ago

        It’s typical I’d say. I corrected it now.

        (It originally said “early 2024” instead of “early 2025”. The YouTube transcript says “around the end of January”.)

    • in-pursuit 8 hours ago

      Can this “expert in math” do binary addition? o1 falls apart after 10 bits, which is easily memorizable.

      • fny 8 hours ago

        Can this "expert in math" write a function that performs binary addition?

        • in-pursuit 6 hours ago

          The issue isn’t performing the specific addition. Rather, you’re asking o1 to take n-bits of data and combine them according to some set of rules. Isn’t that what these models are supposed to excel at, following instructions? Binary addition is interesting because the memorization space grows at 2^n, which is impossible to memorize for moderate values of n.

        • uncomplexity_ 7 hours ago

          this is the way.

          its internal mechanism is still statistical prediction of text in units of tokens. that math seemed lucid enough to be able to use functions.

          • fny 7 hours ago

            It’s like everyone suddenly forgot you can’t do O(n^2) compute in O(n) time.

transcriptase 7 hours ago

Safety: not from causing you physical harm or risking property damage, since there are no guardrails against it confidently walking you through a flawed breadboard circuit that will cause components to explode or immediately catch fire. Then say

“You’re absolutely right. We shouldn’t have run 120v through that capacitor rated for 10v. Here’s an updated design that fixes the issue”, then proceed to explain the same thing with a resistor placed at random.

No we mean safety from our LLM saying something that pisses off a politician, or even worse… hurting someone’s /feelings/.

faizshah 6 hours ago

Did I miss it or did they say whether o3 is going to be available under ChatGPT Plus or Pro?

daft_pink 3 hours ago

We’d really likt to use this today.

throwaway314155 8 hours ago

    def should_upvote(headline: str) -> bool:
        if "o3" in headline.lower():
            return True
        return False
Seriously though, is there anything new here? Also why the need for the editorialized headline? The article is titled "12 Days of OpenAI", not "ChatGPT O3 Preview Announcement" (which frankly makes it sound like it's about to be available to the public, which it isn't).
  • layer8 8 hours ago

       return "o3" in headline.lower()
    
    would have done the job.
    • throwaway314155 8 hours ago

      This is more painful than any downvote. Have an upvote.

      • mercer 7 hours ago

        These threads are my favorite kind of pedantic :)