Rate Limit | Voters

Rate Limit

under review

Anonymous

Rate limits are understandable. I just hit one, using a mix of 405b and 70b. I'd like more information on why this happened, what the rate limits are, and when they reset so I can continue on my project.

November 29, 2024

This post was marked as

under review

M.R.

marked this post as

planned

We are planning to show the rate limits on all the models.

M.R.

Hi 405b right now is at 20RPM and 70b is at 110 RPM. Can you give more context on how many RPM you are doing?

Anonymous

M.R. Don't really remember, but I butted up against 405 once, assumed it was 6/12/24 hours similarly to claude/chatgpt, and went for the 70b. It's good to know it's only a minute.

M.R.

marked this post as

under review