72 points by jkbl
16 days ago
I have a question - how can you afford to run this? I looked at the server costs on google compute and runpod.io, and the ones with GPUs powerful enough to run SD are pretty expensive. I'm guessing you don't have a lot of paying users at the beginning, so I don't think you have enough revenue to cover the costs (at least when you're just getting started).
Do you just spend a lot of money to fund this, and hope that once you have enough users it will pay for itself? Or did you find some affordable way to run a server? If yes, and if it's not a secret - where are you renting the server, what are its specs, and how much does it cost?
On AWS, a g5 instance costs $1/hr. I can generate roughly 10 images per minute (should be able to get this down with some optimization), so 600 images per hour, so the cost per image is 1/6 of a cent, before adding overhead (idle time, start up/shut down).
Source: I run a similar project: https://synapticpaint.com/
I also offer dreambooth model training for around $2-$4 / model as well as inference on custom dreambooth models. Inference on custom models is where things get a little tricky because if users are using different models and you're loading up new models all the time just to generate 6 images, then that quickly becomes the majority of the work load, drastically pushing up the inference cost. I haven't solved this problem yet. If you have any great ideas, feel free to email me (email in profile)!
At the beginning it was just burning money, but it stars to turn into profit.
The only secret to making it affordable is to autoscale based on a current image generation traffic. It runs on a mix of Tesla V100 and RTX 3090 from runpod.io vast.ai and Lambda Labs.
I actually went through a couple of iterations with it, starting as completely free service, then offering one time payments for image credits and now settled on subscriptions as I see there is a demand for the product. Especially AI Editor which I think offers a unique value to the users.
That's amazing, thank you for sharing!
If not a secret, how are you marketing it?
I try to be everywhere, when I have free time from adding new features ;)
Stable diffusion only needs 4GB of VRAM to run on the low end so you can rent low-end consumer GPUs (nvidia RTX for example) for around $0.10 an hour to do the renders.
Yeah, but that's only true when you use one model for yourself. More VRAM is needed for running such a service. It currently loads 6 models per single GPU. And I think I have some VRAM left to add even more.
I was running it for free on google colab here and there with no problems.
Haven’t tried the 2.0 out yet so not sure how that’s going.
https://vast.ai/ (not affiliated)
I'd love to know this as well.
cool, great to see more and more of these coming up!
you can also check out our demo for Stable Diffusion v2. it's free to use, with no email sign-in required and no credit system.
Verify email? No thanks.
Exactly. Put that bullshit up front before I waste time entering a prompt so I know not to bother.
I can’t even register with my own email domain because of “We do not support disposable email addresses!” error
It's a measure to prevent multi accounts. Some people really overuse free offering. Either your domain/IP is on a spam list or your email server may be misconfigured.
How is this a measure? I have my own domain, so why would I make several accounts for your service? I just need one.
And labeling a domain as disposable, when it's clearly isn't, sounds a bit strange to me.
People did that a lot to get new free accounts from disposable email services (You can generate 100 images/mo for free). Around 15% of signups were disposable email multi accounts (40% of email signups).
I use email verification API for this. It states to make decisions based on public email blacklists and lists of disposable emails. Cleary it's not perfect
Well you can also block domains from fakemail.net to prevent disposable emails.
Wow v2 seems worse than v1.5.
They took out a bunch of artist references, and a bunch of celebrities. The two things that made SD stand out. It's no longer the fun one.
Agreed. I like making abstract stuff, much more fun to be had with v1.5.
If you prefer interacting with v2 via code, Erik Bernhardsson got v2 running on https://modal.com in 20 minutes, and it'd take 5 minutes to copy and run his Github gist: https://twitter.com/bernhardsson/status/1595960120021696512.
To OP, I reckon you should allow 1 generation before hitting us with the login prompt. May lift conversion.
Personally, having played around with both for only an hour with identical prompts, v1.5 seems to get better results.
It seems like v2 is more photorealistic but it more often fails to follow any complex prompt.
Came here to point out that my personal email is wrongfully listed as a disposable email address. It must be that it's a three letter url with a .nl TLD.
Maybe take a look at your mail checking API?
Saying that it requires login before someone spends time to think up a description for an image would have been nice (because I won't sign-in to try something anyways).
Edit: rephrased to remove overly negative language.
I don't see this as baiting. The link to a tool page was shared. It's transparent on the homepage and in the header. The text to image page just shows how it works without the need to create an account.
No, it's definitely a dark pattern. Everything about the page suggests that pressing the "generate 4 images" button will generate four images. And then it doesn't and tries to lever that anticipation to get a sign-in. It ends up just making users angry.
If you need a sign-in, e.g. to prevent abuse, you could start by explaining that a sign-in is required and why. At least then people won't be angry when they are ambushed by it
Ok, agree about that. Just did not have time to polish the details. It's not intentional. I've added login to the site, after nearly going bankrupt for offering free generations. The UI needs an update.
It's absolutely not transparent. Showing an active "start process" button that leads to a sign up / login form isntead of starting the process is absolutely not what users want or expect.
I think this is the very definition of baiting.
This site doesn't require a login: https://tinybots.net/artbot?model=stable_diffusion_2.0
Posted by @davely today.
I hate it when website hide login popup until user click on action button. It's such a dark pattern.
FWIW, you're not the only one. On our product, we experimented adding login when the user tries to use any of our tools and something like ~60-70% of users dropped off. So essentially, whoever implements that is killing their user funnel at the very beginning which I'm guessing will have larger effects down the road (fewer users experience "magical moments" which leads to less word-of-mouth, etc).
On the flip side though, I'm sure it may help metrics in the short term especially since it's expensive to offer a service like this (which requires expensive GPU servers).
Proof that people just upvote stuff with stable diffusion in the title without clicking the link or taking more than a cursory glance.
Shameless plug - We don’t require logging in!
Does it generate images though? I gave it a prompt around an hour ago and it's still just spinning.
Yeah, seems like its been hugged to death a bit. A single GPU is not quite enough.
Completes in around a minute for me right now
But do you allow high res nsfw Emma Watson prompts?
I can't wait for the morally concerned to rail against Stable diffusion once they find the /b/ threads and AI is going to get locked down... Its going to happen. "This AI tool enables sick PREDATORS!!"
Doesn’t that just get you those completely black images?
One can deactivate the safety in the source files.
Commercial UI wrappers might or might not do so but should be up front about it.
Here is another that is free AND allows you to create your own custom model: https://88stacks.com yes it does require a login
Wow. That’s pretty fast!