I didn't watch the keynote, but I've been testing MAI Code 2 and its been quite good for my usual work. They put it on par with Opus or Sol, and I wouldn't argue too much with that. Kudos to them for starting from scratch and getting it right.
This. I literally do not care about any of their offerings unless they are open weights.
I'll pay Microsoft to run them if they're open weights. I don't want to deal with the hassle of doing that myself. But I won't even touch them if I can't possibly own the weights myself.
The market is already full of closed weights. We don't need more.
Can i have more explanation please? I'm not in risk management but i would like to understand the situation better. Just risk that they change it under you? Or that they're training on your data, or what kinds of risks are we most worried about?
They can make your model disappear. If you have a system and a set of prompts and evals and everything is working well, it's no fun for that model to just disappear. Some will reply "do a better job building your system so it's not model dependent" and they are sort of right, but that isn't always economically feasible and/or just isn't the reality of how a lot of systems get built.
This assumes material switching costs. I use frontier max plans for now but have fail over models for each class of model action with tuned context so I can keep the performance when I lose the max plan subsidy at a lower price that staying with the frontier labs for certain classes of work.
I see minimal downside in using closed weight models as long as they're behind a router, you have good prod sourced evals and you have fail over to other models configured and tested (running either dark or active:active) with real prod workloads.
If you want relatively repeatable and predictable responses (even within the reality of being non-deterministic) then making sure you'll have continued access to a model to replay responses for debugging and tuning can be important.
Some of their existing offerings provide finetuning service and I guess that'd be sufficient for enterprise customers who're locked into the Microsoft ecosystem anyway.
These are 90-95% cheaper than Anthropic. I'd prefer open source, too, but this has nothing to do with Windows Phone OS (which failed because of network effects).
In this case there is huge demand from companies who consume API tokens at currently high prices who do not want to buy from the labs and who find that existing open source models are starting to lag the frontier too much, or are not actually that cost effective once accounting for the amount of tokens they consume.
The audience here is enterprise looking to save money, and there is no natural monopoly preventing this from gaining traction.
Yeah if you're talking 85-90% of the performance at 10-15% the cost, you're going to win most of the business use cases over. That has been the broad theoretical appeal of the Chinese models, that they might provide that kind of value. Most businesses could not care less about open weights vs not, that does not enter into their discussions very heavily. They care about cost to performance. Fable 5.2 is amazing, and it's as good at eating dollars as it is at producing code.
Price is quite fuzzy too though when it's pricing tokens, because a model that's more token efficient but more expensive per token can be cheaper for a given task. And token efficiency is as fuzzy as performance so you're back where you started.
> The audience here is enterprise looking to save money, and there is no natural monopoly preventing this from gaining traction.
Fun fact - Enterprises are just big groups of people.
If none of your people have ever used a tool because it's expensive, locked away in a some walled garden, and obscure then none of the enterprises will have demand for it. Management might force them to use some cheap model, but users will all be pushing for the models with mindshare, and Microsoft will lose marketshare as a consequence.
Apple knew this when they put Apple IIe's in schools. It's still paying dividends. Today, Anthropic and OpenAI know it and are actively hemorrhaging money trying to become synonymous with AI. Microsoft seems to think that this is all a race to the bottom. I think they're wrong.
FWIW, the frontier labs have like zero barrier to entry, even for general population. In contrast, open weight models require technical expertise to run (and/or paying third parties that host them, which requires researching and tracking which ones work and are trustworthy - i.e. hassle). So you're right in theory, but that argument evaluates strongly in favor of labs & current MS approach, and strongly against open weight.
ho do not want to buy from the labs and who find that existing open source models are starting to lag the frontier too much, or are not actually that cost effective once accounting for the amount of tokens they consume.
one is not true, the other is not all that relevant considering disparity in pricing local vs API even subsidized.
Even if both were true, this is Microsoft. There's negative chance of them producing anything close to frontier anytime soon or at all. They've been absent altogether and relied on others; The little they did is not even in also ran category like grok is for example.
The point is you no longer need frontier models to get “good enough” AI, and MS is offering a marginal improvement over open-source models at very good value
Sharing open weights models is a way to break into a market where you need recognition and brand awareness.
Microsoft doesn’t need any of that. They have the market share, distribution, brand awareness, and a lot of their potential customers already use Microsoft products somewhere.
The phone comparison doesn’t apply, IMO. Phones are entire ecosystems and they’re very sticky. People don’t switch phone OSes casually because they only buy a phone every several years. Getting locked into a phone you don’t like is too risky.
AI plans are not like that. Not yet, anyway. Vendors push for contracts and one year lock ins via discounts, but individuals and nimble companies are changing AI providers all the time.
Even my wife’s big company technically has a contract with one AI provider for the company, but teams across the company are getting extra spending to use on Claude or other models of their choice and the favorites are changing every few months.
Trying an AI model is low risk. You can do it for a month or even just earmark a token budget and try it. Nothing like buying a phone that you’re stuck with for years.
Sharing open weights models is a way to break into a market where you need recognition and brand awareness.
Microsoft doesn’t need any of that. They have the market share, distribution, brand awareness, and a lot of their potential customers already use Microsoft products somewhere.
Knowing Microsoft, they would rather let their closed source OS die than open source it. That's rooted deep into their core DNA and that's exactly what happened to their phones. You can't really change who you are, fundamentally.
Their phones failed because other companies like Google and Apple banned their apps from being in their app store - effectively making it impossible for either Android or iphone users to switch. MS also made it really hard for developers to get their apps in their app store as well. Submissions form failures, long approval processes and bottlenecks with rigid certification rules all contributed to the Windows Phone failure.
It had nothing to do with open sourcing their OS.
Its important to note most of the groundbreaking features the Windows Phone OS had were imitated by both iOS and Android in subsequent years after its failure.
Microsoft already has a large market share in model serving and their AI platform is well integrated into their office-business-cloud offering portfolio.
MS AI inference is heavily used in business, especially among companies who value or require 100% assurance that their data is NOT leaking into the open. Microsoft has a secure AI interference and training platform and provides such guarantees, even for classified information.
Windows phone was hardware and was decades ago... it has little bearing on their AI business model which really more of Cloud offering. Microsoft is doing very well in Cloud services and revenue... Depending how you slice up their cloud services business, Microsoft is the largest (by a fair margin) or second largest cloud computing business in terms of annual revenue.
All in all, if the models perform as well in the real world as they do in benchmarks, this is fairly impressive and also concerning for OpenAI and Anthropic (downward price pressure).
I don't think you can compare to Windows Phone. That was a vastly different situation dependent on hardware partners, cellphone networks and network effects in terms of apps, etc. etc.
If anything this highlights how commoditizable LLMS are. Is it as good as Opus but significantly cheaper? Then that's a very easy switch. Not to mention Office and Windows... they're not short of ways to get this in front of people.
The Ignite keynote looked so shallow and opportunistic to leadership. You wonder if they have any clout anymore, and it feels like the engineers have abandoned the ship. I am working day to day with AI Engineering, and it feels I have zero reason to do business using any of their tech stack. This clearly started with the dev division re-org, they completely missed the memo. There is zero innovation, and it is more than time for Nadella to go.
I'm glad I'm not alone in thinking this. I thought the same about Tim Cook, and some people were angry at me about it, but sometimes you need to pass the torch and let someone else have a go at it to get a fresh vision, Apple could have been further along with AI in my eyes as a solution for running it locally, but they are so risk adverse since the days of Steve Jobs, I want to see Apple be slightly bolder, not just "marketing" boldness.
I think Microsoft needs some serious surgery top to bottom, and to bring back top engineers, there's no reason Google or Microsoft should have taken this long to be comparable to Anthropic and OpenAI, they have historically had highly talented and capable individuals so it has to be the leadership.
If AI is truly their focus, can they stop cannibalizing Windows and make it a less awful OS with less cruft on it? The amount of memory usage on Windows vs Linux or even macOS always astounds me.
Counter point: Apple staying out of AI and simply piling cash while their competitors burn it is the reason their stock price is soaring and may turn out to be a very savvy business decision.
And about running local models, they seem to be the number one recommended option for that? I don’t have much knowledge around local models though, I may be missing something, but I would guess their hardware sales have increased because of AI.
It’s second Ignite keynote in a row that is totally unimpressive and uninspiring. At least Satya Nadella came back to show he still runs the vision of the company (whatever the vision is). last year his COO entitled as some minor CEO of business ran the whole show and it was very confusing.
They still suck at AI vendor and struggle to evangelize that they are just an AI integrator with something like AI-Biztalk that is not easy to position as legitimate product.
It was interesting to pitch CoPilot as AI-OS idea… but they don’t look like they can succeed converting it from buzzword to reality and swarming agents is something they can hardly monopolize…
I do believe they are preparing a succession plan for Nadella thus the second CEO not a simple COO like with Ballmer-Turner duo in the past
This seems a pretty bold statement, especially the Opus 5.5 comparison.
"MAI Code 2 reaches 98% of the coding quality of GPT-6.1 Sol at about 40% of the price. And against Opus 5.5, it reaches 96% performance for just 5% of the price."
I think if they announced MAI Code 2 Flash to be not just for coding , but for other applications as well, it would do a lot better considering its 65% the cost of GPT-6 Luna.
Yes, for general language tasks, Google's models win. I wish we had more choices in non-coding space, but even the locally hosted Gemma4 models win against the cheap Sonnet / Luna options.
MAI Image 2.6 Flash was about 2c / image, and it looks like 2.7 Flash is 1c / image. I used 2.6-Flash as a backup when my low cost Krea2 provider flaked out and the results were surprisingly ok (comparable with Krea2 Medium Turbo, cheapest provider cost is 0.67c / image).
At 1c it might even be a default choice, I'll definitely try it out.
I'd be curious to hear how AI purchasing is really significantly different from other tech purchasing decisions. Seems like the enterprises that are accustomed to strong-handed mandates from on-high will continue to make tech decisions from the corner office, and the smaller orgs or more heterodox ones will continue to listen to ICs and management who surface new tools.
Even if they are talking to execs this comparison is still maliciously misleading. If facts and truth don't matter anymore anything in this age then why not add a few more zeroes to this number...
Tangential to this, but I really hate the use of “#x times cheaper” when describing a price difference, especially when it takes place after an “#x times faster” statement. It’s initially confusing and makes it harder to mentally calculate the actual difference. Just give it as a percentage!
What do you mean "the actual difference"? 79 times cheaper means costing 1/79 of compared price. That's what it is.
Or do you mean you want to see it in the format of decimal fraction?
> MAI Code 2 reaches 98% of the coding quality of GPT-6.1 Sol at about 40% of the price.
To me, this smells like the same trick I always see in claims about model routers. As in, running against a saturated benchmark then showing huge cost savings for a tiny performance drop (because almost any model will perform well).
Looking deeper, though, it looks like they are citing four benchmarks, only one of which is basically saturated (Terminal Bench 2.1).
On the other hand, on 2/4 of these benchmarks Sol 6.1 does better than Opus 5.5, which just doesn't pass the sniff test, so my conclusion is that these are cherrypicked benchmarks.
I haven't been this excited about Microsoft products since they released their new Version of Editor for Windows 11 with support for multiple(!) undo steps in 2022[1]
>MAI Code 2 reaches 98% of the coding quality of GPT-6.1 Sol at about 40% of the price. And against Opus 5.5, it reaches 96% performance for just 5% of the price.
>MAI Code 2 Flash matches the performance of GPT-6 Luna at 65% of the price, and Haiku 5.5 at 20% of the price.
I didn't watch the keynote, but I've been testing MAI Code 2 and its been quite good for my usual work. They put it on par with Opus or Sol, and I wouldn't argue too much with that. Kudos to them for starting from scratch and getting it right.
I thought they were in bed with OpenAI. Did that change? I'm so not up-to-date...
I think Microsoft should provide some of its models as open source/weight if they hope to secure any market share.
Otherwise, it's Windows Phone OS all over again.
This. I literally do not care about any of their offerings unless they are open weights.
I'll pay Microsoft to run them if they're open weights. I don't want to deal with the hassle of doing that myself. But I won't even touch them if I can't possibly own the weights myself.
The market is already full of closed weights. We don't need more.
You have stated your position but not explained it. How does it help you if the weights are open?
Risk.
Can i have more explanation please? I'm not in risk management but i would like to understand the situation better. Just risk that they change it under you? Or that they're training on your data, or what kinds of risks are we most worried about?
They can make your model disappear. If you have a system and a set of prompts and evals and everything is working well, it's no fun for that model to just disappear. Some will reply "do a better job building your system so it's not model dependent" and they are sort of right, but that isn't always economically feasible and/or just isn't the reality of how a lot of systems get built.
You must be new here
History shows that if you give a corporation power to extract money from you, most of them will do that without any regard to the user.
That power is the model weights. If there is a market around open weights, they will exist and corps will not be able to squeeze so hard.
Unfortunately not many people understand this simple and intuitive reality, and thats why we suffer
This assumes material switching costs. I use frontier max plans for now but have fail over models for each class of model action with tuned context so I can keep the performance when I lose the max plan subsidy at a lower price that staying with the frontier labs for certain classes of work.
I see minimal downside in using closed weight models as long as they're behind a router, you have good prod sourced evals and you have fail over to other models configured and tested (running either dark or active:active) with real prod workloads.
If you want relatively repeatable and predictable responses (even within the reality of being non-deterministic) then making sure you'll have continued access to a model to replay responses for debugging and tuning can be important.
Yes, we do need more. I would like significantly lower price for same performance. I'd like higher throughput.
Commoditize your complement.
But you have to choose which is your complement and which is your main product.
Some of their existing offerings provide finetuning service and I guess that'd be sufficient for enterprise customers who're locked into the Microsoft ecosystem anyway.
It's not enough for companies outside the US, though.
This topic has its own dedicated section in the linked page.
These are 90-95% cheaper than Anthropic. I'd prefer open source, too, but this has nothing to do with Windows Phone OS (which failed because of network effects).
In this case there is huge demand from companies who consume API tokens at currently high prices who do not want to buy from the labs and who find that existing open source models are starting to lag the frontier too much, or are not actually that cost effective once accounting for the amount of tokens they consume.
The audience here is enterprise looking to save money, and there is no natural monopoly preventing this from gaining traction.
100% this. Lots of people want cheaper. The demand for same performance but cheaper is off the charts.
Or even 90% of the performance but much cheaper. Many business tasks to not require frontier intelligence and were solvable two years ago.
Yeah if you're talking 85-90% of the performance at 10-15% the cost, you're going to win most of the business use cases over. That has been the broad theoretical appeal of the Chinese models, that they might provide that kind of value. Most businesses could not care less about open weights vs not, that does not enter into their discussions very heavily. They care about cost to performance. Fable 5.2 is amazing, and it's as good at eating dollars as it is at producing code.
The performance is really fuzzy too, but the price you do know for certain.
Price is quite fuzzy too though when it's pricing tokens, because a model that's more token efficient but more expensive per token can be cheaper for a given task. And token efficiency is as fuzzy as performance so you're back where you started.
> The audience here is enterprise looking to save money, and there is no natural monopoly preventing this from gaining traction.
Fun fact - Enterprises are just big groups of people.
If none of your people have ever used a tool because it's expensive, locked away in a some walled garden, and obscure then none of the enterprises will have demand for it. Management might force them to use some cheap model, but users will all be pushing for the models with mindshare, and Microsoft will lose marketshare as a consequence.
Apple knew this when they put Apple IIe's in schools. It's still paying dividends. Today, Anthropic and OpenAI know it and are actively hemorrhaging money trying to become synonymous with AI. Microsoft seems to think that this is all a race to the bottom. I think they're wrong.
FWIW, the frontier labs have like zero barrier to entry, even for general population. In contrast, open weight models require technical expertise to run (and/or paying third parties that host them, which requires researching and tracking which ones work and are trustworthy - i.e. hassle). So you're right in theory, but that argument evaluates strongly in favor of labs & current MS approach, and strongly against open weight.
ho do not want to buy from the labs and who find that existing open source models are starting to lag the frontier too much, or are not actually that cost effective once accounting for the amount of tokens they consume.
one is not true, the other is not all that relevant considering disparity in pricing local vs API even subsidized.
Even if both were true, this is Microsoft. There's negative chance of them producing anything close to frontier anytime soon or at all. They've been absent altogether and relied on others; The little they did is not even in also ran category like grok is for example.
The point is you no longer need frontier models to get “good enough” AI, and MS is offering a marginal improvement over open-source models at very good value
> if they hope to secure any market share
Google and Microsoft are already the bulk of the market share.
Most knowledge workers are either on Microsoft 365 or Google cloud services for anything from mail to meetings, calendars, calcs, etc.
And all of Gemini and Copilot have already moved into the offices of most people.
Sharing open weights models is a way to break into a market where you need recognition and brand awareness.
Microsoft doesn’t need any of that. They have the market share, distribution, brand awareness, and a lot of their potential customers already use Microsoft products somewhere.
The phone comparison doesn’t apply, IMO. Phones are entire ecosystems and they’re very sticky. People don’t switch phone OSes casually because they only buy a phone every several years. Getting locked into a phone you don’t like is too risky.
AI plans are not like that. Not yet, anyway. Vendors push for contracts and one year lock ins via discounts, but individuals and nimble companies are changing AI providers all the time.
Even my wife’s big company technically has a contract with one AI provider for the company, but teams across the company are getting extra spending to use on Claude or other models of their choice and the favorites are changing every few months.
Trying an AI model is low risk. You can do it for a month or even just earmark a token budget and try it. Nothing like buying a phone that you’re stuck with for years.
They just need to make VS Code’s tools as attractive as Codex/Claude. Their harness layer has fallen behind. (Could they just vibe one up? Hmm.)
Sharing open weights models is a way to break into a market where you need recognition and brand awareness.
Microsoft doesn’t need any of that. They have the market share, distribution, brand awareness, and a lot of their potential customers already use Microsoft products somewhere.
https://deepmind.google/models/gemma/
https://openai.com/index/introducing-gpt-oss/
Knowing Microsoft, they would rather let their closed source OS die than open source it. That's rooted deep into their core DNA and that's exactly what happened to their phones. You can't really change who you are, fundamentally.
Their phones failed because other companies like Google and Apple banned their apps from being in their app store - effectively making it impossible for either Android or iphone users to switch. MS also made it really hard for developers to get their apps in their app store as well. Submissions form failures, long approval processes and bottlenecks with rigid certification rules all contributed to the Windows Phone failure.
It had nothing to do with open sourcing their OS.
Its important to note most of the groundbreaking features the Windows Phone OS had were imitated by both iOS and Android in subsequent years after its failure.
Microsoft already has a large market share in model serving and their AI platform is well integrated into their office-business-cloud offering portfolio.
MS AI inference is heavily used in business, especially among companies who value or require 100% assurance that their data is NOT leaking into the open. Microsoft has a secure AI interference and training platform and provides such guarantees, even for classified information.
Also: this is important -- https://microsoft.ai/news/introducing-mai-licensed-weights/
Windows phone was hardware and was decades ago... it has little bearing on their AI business model which really more of Cloud offering. Microsoft is doing very well in Cloud services and revenue... Depending how you slice up their cloud services business, Microsoft is the largest (by a fair margin) or second largest cloud computing business in terms of annual revenue.
All in all, if the models perform as well in the real world as they do in benchmarks, this is fairly impressive and also concerning for OpenAI and Anthropic (downward price pressure).
I don't think you can compare to Windows Phone. That was a vastly different situation dependent on hardware partners, cellphone networks and network effects in terms of apps, etc. etc.
If anything this highlights how commoditizable LLMS are. Is it as good as Opus but significantly cheaper? Then that's a very easy switch. Not to mention Office and Windows... they're not short of ways to get this in front of people.
The Ignite keynote looked so shallow and opportunistic to leadership. You wonder if they have any clout anymore, and it feels like the engineers have abandoned the ship. I am working day to day with AI Engineering, and it feels I have zero reason to do business using any of their tech stack. This clearly started with the dev division re-org, they completely missed the memo. There is zero innovation, and it is more than time for Nadella to go.
> and it is more than time for Nadella to go.
I'm glad I'm not alone in thinking this. I thought the same about Tim Cook, and some people were angry at me about it, but sometimes you need to pass the torch and let someone else have a go at it to get a fresh vision, Apple could have been further along with AI in my eyes as a solution for running it locally, but they are so risk adverse since the days of Steve Jobs, I want to see Apple be slightly bolder, not just "marketing" boldness.
I think Microsoft needs some serious surgery top to bottom, and to bring back top engineers, there's no reason Google or Microsoft should have taken this long to be comparable to Anthropic and OpenAI, they have historically had highly talented and capable individuals so it has to be the leadership.
If AI is truly their focus, can they stop cannibalizing Windows and make it a less awful OS with less cruft on it? The amount of memory usage on Windows vs Linux or even macOS always astounds me.
Counter point: Apple staying out of AI and simply piling cash while their competitors burn it is the reason their stock price is soaring and may turn out to be a very savvy business decision.
And about running local models, they seem to be the number one recommended option for that? I don’t have much knowledge around local models though, I may be missing something, but I would guess their hardware sales have increased because of AI.
It’s second Ignite keynote in a row that is totally unimpressive and uninspiring. At least Satya Nadella came back to show he still runs the vision of the company (whatever the vision is). last year his COO entitled as some minor CEO of business ran the whole show and it was very confusing.
They still suck at AI vendor and struggle to evangelize that they are just an AI integrator with something like AI-Biztalk that is not easy to position as legitimate product.
It was interesting to pitch CoPilot as AI-OS idea… but they don’t look like they can succeed converting it from buzzword to reality and swarming agents is something they can hardly monopolize…
I do believe they are preparing a succession plan for Nadella thus the second CEO not a simple COO like with Ballmer-Turner duo in the past
Why are they not listed in the Artificial Analysis index?
This seems a pretty bold statement, especially the Opus 5.5 comparison.
"MAI Code 2 reaches 98% of the coding quality of GPT-6.1 Sol at about 40% of the price. And against Opus 5.5, it reaches 96% performance for just 5% of the price."
I wonder if the cost is artificially lowered (using lower cost they set themselves for something) or if there are an objective calculation there.
I found their transcription model to be one of the best i have used
so how do I use these exactly?
[delayed]
I think if they announced MAI Code 2 Flash to be not just for coding , but for other applications as well, it would do a lot better considering its 65% the cost of GPT-6 Luna.
Yes, for general language tasks, Google's models win. I wish we had more choices in non-coding space, but even the locally hosted Gemma4 models win against the cheap Sonnet / Luna options.
Happy that this time they are releasing them beyond GHCP too. Looking forward to test the flash one.
Release the weights you cowards!
MAI Image 2.6 Flash was about 2c / image, and it looks like 2.7 Flash is 1c / image. I used 2.6-Flash as a backup when my low cost Krea2 provider flaked out and the results were surprisingly ok (comparable with Krea2 Medium Turbo, cheapest provider cost is 0.67c / image).
At 1c it might even be a default choice, I'll definitely try it out.
Related:
MAI Code 2 and Code 2 Flash
https://news.ycombinator.com/item?id=50535885
Copy paste issue maybe...that's "Pre-auth RCE in Nginx HTTP/2 handling"
is MAI a different team than the one that does Phi?
"Decision 1.1 is the latest decision model from Microsoft, 50x faster and 79x cheaper than GPT-6.1 Sol"... uhm okay. What a useless comparison.
They're talking to executives not developers.
I had this thought yesterday, the era of developers picking tech is probably over. Microsoft's wheelhouse is selling to upstairs.
They're going to eat everybody's lunch that is still playing the old game of selling to the devs.
I'd be curious to hear how AI purchasing is really significantly different from other tech purchasing decisions. Seems like the enterprises that are accustomed to strong-handed mandates from on-high will continue to make tech decisions from the corner office, and the smaller orgs or more heterodox ones will continue to listen to ICs and management who surface new tools.
Has this been true pre-AI? It has always been sold to executives, no?
It was a short era
> Microsoft's wheelhouse is selling to upstairs.
It's the modern era version of "Nobody ever got fired for buying IBM"
Even if they are talking to execs this comparison is still maliciously misleading. If facts and truth don't matter anymore anything in this age then why not add a few more zeroes to this number...
> the era of developers picking tech is probably over
Don't really know when that era ever existed
Tangential to this, but I really hate the use of “#x times cheaper” when describing a price difference, especially when it takes place after an “#x times faster” statement. It’s initially confusing and makes it harder to mentally calculate the actual difference. Just give it as a percentage!
What do you mean "the actual difference"? 79 times cheaper means costing 1/79 of compared price. That's what it is. Or do you mean you want to see it in the format of decimal fraction?
Instead of “79x cheaper” say “1.26% of the cost” so readers can quickly do a mental cost comparison
Makes me doubt the rest of their claims when you see something like that
It is also substantially better on most frontier benchmarks than a bash script with a random number generator.
> MAI Code 2 reaches 98% of the coding quality of GPT-6.1 Sol at about 40% of the price.
To me, this smells like the same trick I always see in claims about model routers. As in, running against a saturated benchmark then showing huge cost savings for a tiny performance drop (because almost any model will perform well).
Looking deeper, though, it looks like they are citing four benchmarks, only one of which is basically saturated (Terminal Bench 2.1).
On the other hand, on 2/4 of these benchmarks Sol 6.1 does better than Opus 5.5, which just doesn't pass the sniff test, so my conclusion is that these are cherrypicked benchmarks.
> Today, we’re taking a big step forward with MAI Licensed Weights: models under your control.
>Take a frontier MAI model, customize it using your proprietary data if you want to. Then run it securely in your own Azure environment.
Ohh Microsoft. Is it really my environment if it’s Azure ?
Anyway I wonder if GitHub Co pilot will start auto routing to these new models. All those gamed efficiency metrics sure do look impressive.
This whole article is strange. It’s as if Microsoft is seeing the Anthropic IPO and saying “um we have models too”
and the crowd goes mild
I haven't been this excited about Microsoft products since they released their new Version of Editor for Windows 11 with support for multiple(!) undo steps in 2022[1]
[1] https://blogs.windows.com/windows-insider/2021/12/07/redesig...
It will look like its useful. There will be business brochures about its being useful. Some sad engineers at sad megacorps will be forced to use it.
But at the end of the day: it will be what all other microsoft products turned up to be: an utter waste of time.
Spend your time on Claude, Gemini, Kimi, Trinity or even Deepseek. And thank me later.
>MAI Code 2 reaches 98% of the coding quality of GPT-6.1 Sol at about 40% of the price. And against Opus 5.5, it reaches 96% performance for just 5% of the price.
>MAI Code 2 Flash matches the performance of GPT-6 Luna at 65% of the price, and Haiku 5.5 at 20% of the price.
These are quiet some claims!
> Claude, search through every benchmark and comparison model combination to find the best performance vs. cost claim we can make about MAI Code 2.
Is it world class because someone says so?
I believe they assert that claim by citing benchmarks against other "world class" models. It's not a term of art it's subjective.
"world-class" is one way to say "not-frontier"
No local models? Meh...
they wouldn't want us not to pay them on subscriptions, would they?
Haven't used any Microsoft technologies for over 10 years. Why is this company still in business?
Me neither. Market Cap: 3.75T. Clearly our use isn't correlated with some extremely large software markets (aka enterprise IT).
Weak models, closed weights, no technical information
Mostly PR stunt the day of Anthrophic's IPO.