More tickets and larger tickets, full migrations that used to take 4 weeks coordinating with 3 teams are now a single PR done in a day.
edit: if you're seeing a slow down in PRs, it's more likely that 10 of your 10x'ers are slinging code in 3-4 plus accounts in codex on the side during their shift on 8 startups.
In the past splitting diffs was an important process to speed up and simplify code review.
But now I would rather make one PR per service to simplify CI and deploy. As a result PRs become much much larger.
I am shipping so much more, but I don't know that our customers would necessarily know it. Total rewrites that needed to be done but were getting pushed off due to the scope are now getting done. Security issues are getting patched. Support ticket open to resolution time is dropping. So yes, shipping a lot faster to create a much better project rather than just focusing on features.
I'm shipping faster, but not as fast if the output was the same as before. AI allows for deeper code, all the nice to haves you wouldn't normally do. Test coverage is now fully complete as well, and I mean full tilt mocks and every edge case, not just the happy path plus bugs found in testing.
The excitement of LLMs has been around the productivity of the engineers, not the quality of the projects. Traditionally, we have bottlenecks at review and QA stages for new work, and a lot of orgs turn on the firehose of new code without fixing those bottlenecks.
If you want to drive at high speed, you need to build a highway first.
For entertainment, it's definitely been huge for gaming. In Roblox the majority of games now are AI generated. Of the top 100 games, 80 used AI in some way or another and there's 70,000 AI generated games total. Roblox has a huge number of players too (~380 MAU) so tons of people are playing AI generated games.
I think it would be more widespread if there wasn't as much pushback against AI. Big Walk disclosed they used ai to fix a bug and it immediately got review bombed. Kids on Roblox don't care as much, so you can see just how transformative it has been there.
I'm sure the release cadence on browser updates has gone up; and thanks to all the CVEs getting found now, there's definitely real value from them, even if we simply wouldn't have known about all the risks if it were not for the same AI solving them.
More tickets and larger tickets, full migrations that used to take 4 weeks coordinating with 3 teams are now a single PR done in a day.
edit: if you're seeing a slow down in PRs, it's more likely that 10 of your 10x'ers are slinging code in 3-4 plus accounts in codex on the side during their shift on 8 startups.
In the past splitting diffs was an important process to speed up and simplify code review. But now I would rather make one PR per service to simplify CI and deploy. As a result PRs become much much larger.
I am shipping so much more, but I don't know that our customers would necessarily know it. Total rewrites that needed to be done but were getting pushed off due to the scope are now getting done. Security issues are getting patched. Support ticket open to resolution time is dropping. So yes, shipping a lot faster to create a much better project rather than just focusing on features.
I'm shipping faster, but not as fast if the output was the same as before. AI allows for deeper code, all the nice to haves you wouldn't normally do. Test coverage is now fully complete as well, and I mean full tilt mocks and every edge case, not just the happy path plus bugs found in testing.
We are. A month of work turned into one day.
We definitely see more broken features that was removed after a short amount of time.
The excitement of LLMs has been around the productivity of the engineers, not the quality of the projects. Traditionally, we have bottlenecks at review and QA stages for new work, and a lot of orgs turn on the firehose of new code without fixing those bottlenecks.
If you want to drive at high speed, you need to build a highway first.
At least in our case, we are shipping faster. The rate of bugs has gone up, but still proportional to the behavior changes.
I think the recent article by Rober Haas on why Postgres release is delayed is giving a very good insight into the general "why".
We are definitely shipping faster. Does that turn to better products? Not necessarily.
[delayed]
Aren’t we?
Remembering that LOC and commits don't count, what metrics or even personal experience show that users are getting more features faster?
At least in entertainment I only see cancelled products rapidly increasing.
I definitely see more broken features!
Maybe this time we get people to abandon the big, dysfunctional companies that were never actually able to write software.
For entertainment, it's definitely been huge for gaming. In Roblox the majority of games now are AI generated. Of the top 100 games, 80 used AI in some way or another and there's 70,000 AI generated games total. Roblox has a huge number of players too (~380 MAU) so tons of people are playing AI generated games.
I think it would be more widespread if there wasn't as much pushback against AI. Big Walk disclosed they used ai to fix a bug and it immediately got review bombed. Kids on Roblox don't care as much, so you can see just how transformative it has been there.
Roblox is played exclusively by children. Children have the taste nuance of insisting chicken nuggets with ketchup are the epitome of cuisine.
I'm sure the release cadence on browser updates has gone up; and thanks to all the CVEs getting found now, there's definitely real value from them, even if we simply wouldn't have known about all the risks if it were not for the same AI solving them.
Speak for yourself, mate
I work for a midsize company within retail and we are definitely shipping faster?
Who is not shipping faster? We definitely are.
We definitely are.
Because we spend time writing clickbait articles
We are.
We are. This has got to be clickbait.