Use tokens to enforce limits #8

Closed
opened 2023-07-28 17:28:16 +02:00 by Wroclaw · 3 comments
Owner

Requests count might not be good to limit users.
A better alternative would be limiting based on token usage count.
Even better: have non-generated tokens count half as much.

Requests count might not be good to limit users. A better alternative would be limiting based on token usage count. Even better: have non-generated tokens count half as much.
Wroclaw added the
enhancement
label 2023-07-28 17:28:16 +02:00
Author
Owner

also rename limits to quota

also rename limits to quota
Author
Owner

another suggested name: usage

another suggested name: usage
Author
Owner

Implemented in 6792c05959

Implemented in 6792c059597c37accaf70ea584f53c50165fdc68
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: Wroclaw/GPTcord#8
No description provided.