points by barbegal a year ago There's some dodgy maths>( 100 / 157,075,200 ) * 1,000,000 = $0.000000636637738Should be $0.64 so still expensive
jasonjmcghee a year ago being 6 orders of magnitude off in your cost calculation isn't great.groq costs about that for llama 3 70b (which is a monumentally better model) and 1/10th of that for llama 3 8b pants2 a year ago Groq doesn’t currently have a paid API that one can sign up for. jasonjmcghee a year ago Yup. True. Should say "will" - currently free but heavily rate-limited. Together AI looks to be about $0.30 / 1M tokens, as another price comparison. Which you can pay for.
pants2 a year ago Groq doesn’t currently have a paid API that one can sign up for. jasonjmcghee a year ago Yup. True. Should say "will" - currently free but heavily rate-limited. Together AI looks to be about $0.30 / 1M tokens, as another price comparison. Which you can pay for.
jasonjmcghee a year ago Yup. True. Should say "will" - currently free but heavily rate-limited. Together AI looks to be about $0.30 / 1M tokens, as another price comparison. Which you can pay for.
being 6 orders of magnitude off in your cost calculation isn't great.
groq costs about that for llama 3 70b (which is a monumentally better model) and 1/10th of that for llama 3 8b
Groq doesn’t currently have a paid API that one can sign up for.
Yup. True. Should say "will" - currently free but heavily rate-limited. Together AI looks to be about $0.30 / 1M tokens, as another price comparison. Which you can pay for.