> The marketplace sellers that we caught only had to list a model at the lowest price, enable request logging, and wait. What stood out is how personal it was – these were individuals, working from what looked like home internet connections and personal computers, trying to break into our canary servers one login at a time.
> In one case, we sent two prompts through a single seller’s offer. About a day and a half later, someone on a home broadband connection opened both secret URLs in a desktop browser and started guessing usernames at the login page. Prompts for the same model that went through a different seller were never touched, which tells us that the leak follows the seller and not the marketplace as a whole.
This is wild. Definitely scares me a bit about non US/EU inference providers. The ‘ZDR’ being completely non ZDR is pretty scary.
So insane.
My takeaway is: Only use hyperscalers or major first party vendors (like the "labs").
If using routers or marketplaces, assume anything that goes in is public
It sounded like a good deal?
> The marketplace sellers that we caught only had to list a model at the lowest price, enable request logging, and wait. What stood out is how personal it was – these were individuals, working from what looked like home internet connections and personal computers, trying to break into our canary servers one login at a time.
> In one case, we sent two prompts through a single seller’s offer. About a day and a half later, someone on a home broadband connection opened both secret URLs in a desktop browser and started guessing usernames at the login page. Prompts for the same model that went through a different seller were never touched, which tells us that the leak follows the seller and not the marketplace as a whole.
Great research, I'm just a little disappointed they didn't name names.
MiniMax is the root cause problem and OpenRouter the top level problem https://x.com/michael_chomsky/status/2124008002571428224?s=4...